[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:15:43 dist-test-slave-nj21 krb5kdc[28530](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:15:43 dist-test-slave-nj21 krb5kdc[28530](info): set up 2 sockets
Aug 09 16:15:43 dist-test-slave-nj21 krb5kdc[28530](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 16:15:44.321079 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:15:44 dist-test-slave-nj21 krb5kdc[28530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:15:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:15:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:15:44.431758 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45999
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:45999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:44.511062 28552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:44.511258 28552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:44.511287 28552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:44.512418 28552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:15:44.512460 28552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:44.512488 28552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:44.512506 28552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:15:44.512529 28552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:15:44.513976 28552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:45999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:44.514200 28552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:44.514421 28552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:44.518992 28558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:44.519001 28559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:44.519047 28552 server_base.cc:1034] running on GCE node
W20260809 16:15:44.519001 28562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:44.519394 28552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:44.519706 28552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:44.520881 28552 hybrid_clock.cc:648] HybridClock initialized: now 1786292144520899 us; error 61 us; skew 500 ppm
Aug 09 16:15:44 dist-test-slave-nj21 krb5kdc[28530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:44.523273 28552 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:15:44.523694 28552 webserver.cc:460] Webserver started at http://127.27.217.62:46519/ using document root <none> and password file <none>
I20260809 16:15:44.523900 28552 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:44.523945 28552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:44.524035 28552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:44.525055 28552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "d868e5dba08a4c3b82ef89f9b33ea68e"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "5ae0c04fc0b5fb99246139871a4dc0bf"
server_key_iv: "e1f7ed510110acd5a6f1394de52d9904"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.525341 28552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "d868e5dba08a4c3b82ef89f9b33ea68e"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "5ae0c04fc0b5fb99246139871a4dc0bf"
server_key_iv: "e1f7ed510110acd5a6f1394de52d9904"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.526592 28552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:15:44.527216 28571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:44.527359 28552 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:44.527431 28552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "d868e5dba08a4c3b82ef89f9b33ea68e"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "5ae0c04fc0b5fb99246139871a4dc0bf"
server_key_iv: "e1f7ed510110acd5a6f1394de52d9904"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.527498 28552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:44.547533 28552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:44.549250 28552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:44.549373 28552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:44.553143 28552 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:45999
I20260809 16:15:44.553197 28646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:45999 every 8 connection(s)
I20260809 16:15:44.553501 28552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:15:44.554343 28647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:44.556165 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 28552
I20260809 16:15:44.556243 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:15:44.556674 28647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e: Bootstrap starting.
I20260809 16:15:44.556856 28516 external_mini_cluster.cc:1428] Setting key 70caea65ea9fd1b30e4b13ad3067ea95
I20260809 16:15:44.557266 28647 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:44.557595 28647 log.cc:824] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:44.558355 28647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e: No bootstrap required, opened a new log
I20260809 16:15:44.560057 28647 raft_consensus.cc:348] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d868e5dba08a4c3b82ef89f9b33ea68e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45999 } }
I20260809 16:15:44.560187 28647 raft_consensus.cc:374] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:44.560218 28647 raft_consensus.cc:729] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868e5dba08a4c3b82ef89f9b33ea68e, State: Initialized, Role: FOLLOWER
I20260809 16:15:44.560355 28647 consensus_queue.cc:260] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d868e5dba08a4c3b82ef89f9b33ea68e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45999 } }
I20260809 16:15:44.560420 28647 raft_consensus.cc:388] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:15:44.560451 28647 raft_consensus.cc:482] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:15:44.560497 28647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:44.561254 28647 raft_consensus.cc:504] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d868e5dba08a4c3b82ef89f9b33ea68e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45999 } }
I20260809 16:15:44.561352 28647 leader_election.cc:302] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d868e5dba08a4c3b82ef89f9b33ea68e; no voters:
I20260809 16:15:44.561512 28647 leader_election.cc:288] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:15:44.561550 28653 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:44.561658 28653 raft_consensus.cc:686] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [term 1 LEADER]: Becoming Leader. State: Replica: d868e5dba08a4c3b82ef89f9b33ea68e, State: Running, Role: LEADER
I20260809 16:15:44.561743 28653 consensus_queue.cc:237] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d868e5dba08a4c3b82ef89f9b33ea68e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45999 } }
I20260809 16:15:44.561776 28647 sys_catalog.cc:564] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:15:44.562158 28654 sys_catalog.cc:455] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d868e5dba08a4c3b82ef89f9b33ea68e. Latest consensus state: current_term: 1 leader_uuid: "d868e5dba08a4c3b82ef89f9b33ea68e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d868e5dba08a4c3b82ef89f9b33ea68e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45999 } } }
I20260809 16:15:44.562256 28654 sys_catalog.cc:458] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:44.562413 28656 sys_catalog.cc:455] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d868e5dba08a4c3b82ef89f9b33ea68e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d868e5dba08a4c3b82ef89f9b33ea68e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45999 } } }
I20260809 16:15:44.562467 28656 sys_catalog.cc:458] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:44.562767 28662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:15:44.563273 28662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:15:44.564848 28662 catalog_manager.cc:1347] Generated new cluster ID: bc1cae3eac2e4d66918db3d3818a114d
I20260809 16:15:44.564900 28662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:15:44 dist-test-slave-nj21 krb5kdc[28530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:44.572412 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:44.557748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48522 (local address 127.27.217.62:45999)
0809 16:15:44.557903 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:44.557913 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:44.558211 (+ 298us) server_negotiation.cc:407] Connection header received
0809 16:15:44.560027 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:44.560032 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:44.560073 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:44.560185 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:44.561842 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.563443 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.564828 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.565274 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.565330 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:44.568525 (+ 3195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:44.568529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:44.568529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:44.568540 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:44.570679 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:44.571071 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:44.571073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:44.571073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:44.571166 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:44.571392 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:44.571393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:44.571393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:44.571617 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:44.571788 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:44.572047 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 16:15:44.572192 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":83,"threads_started":1}
I20260809 16:15:44.577911 28662 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:15:44.578593 28662 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:15:44.588413 28662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d868e5dba08a4c3b82ef89f9b33ea68e: Generated new TSK 0
I20260809 16:15:44.588599 28662 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:15:44.615731 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45999
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:44.695297 28687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:44.695500 28687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:44.695534 28687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:44.696700 28687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:44.696744 28687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:44.696779 28687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:15:44.698207 28687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:44.698447 28687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:44.698657 28687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:44.703347 28696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:44.703305 28698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:44.703299 28695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:44.703501 28687 server_base.cc:1034] running on GCE node
I20260809 16:15:44.703722 28687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:44.703969 28687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:44.705114 28687 hybrid_clock.cc:648] HybridClock initialized: now 1786292144705102 us; error 28 us; skew 500 ppm
Aug 09 16:15:44 dist-test-slave-nj21 krb5kdc[28530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:44.707500 28687 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:15:44.707916 28687 webserver.cc:460] Webserver started at http://127.27.217.1:39385/ using document root <none> and password file <none>
I20260809 16:15:44.708110 28687 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:44.708151 28687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:44.708241 28687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:44.709187 28687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "fb3871128d66442982dd835b1766070d"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "1681a535e61c0db2c6ed863fa954a8a6"
server_key_iv: "d015934ec4a91a948fd2005b867a21d4"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.709578 28687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "fb3871128d66442982dd835b1766070d"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "1681a535e61c0db2c6ed863fa954a8a6"
server_key_iv: "d015934ec4a91a948fd2005b867a21d4"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.710758 28687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:15:44.711376 28711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:44.711553 28687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:44.711632 28687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "fb3871128d66442982dd835b1766070d"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "1681a535e61c0db2c6ed863fa954a8a6"
server_key_iv: "d015934ec4a91a948fd2005b867a21d4"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.711716 28687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:44.724829 28687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:44.726497 28687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:44.726601 28687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:44.726773 28687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:44.727025 28687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:44.727053 28687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:44.727074 28687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:44.727090 28687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:44.732944 28687 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:35175
I20260809 16:15:44.733017 28884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:35175 every 8 connection(s)
I20260809 16:15:44.733278 28687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
Aug 09 16:15:44 dist-test-slave-nj21 krb5kdc[28530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:44.740599 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 28687
I20260809 16:15:44.740694 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:15:44.740851 28516 external_mini_cluster.cc:1428] Setting key 3cab8f1fcc362798ecc7ac15837e828c
I20260809 16:15:44.741990 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:44.734072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:46033 (local address 127.27.217.62:45999)
0809 16:15:44.734130 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:44.734132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:44.734313 (+ 181us) server_negotiation.cc:407] Connection header received
0809 16:15:44.734803 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:44.734804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:44.734822 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:44.734876 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:44.735859 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.736356 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.737296 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.737498 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.737554 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:44.739430 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:44.739431 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:44.739432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:44.739439 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:44.740600 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:44.741072 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:44.741073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:44.741074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:44.741137 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:44.741355 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:44.741355 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:44.741356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:44.741500 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:44.741558 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:44.741853 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 16:15:44.741926 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:15:44.742218 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:44.734038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45999 (local address 127.27.217.1:46033)
0809 16:15:44.734201 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:44.734235 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:44.734709 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:44.734945 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:44.734948 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:44.735549 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:44.735768 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:44.735774 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.736442 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.736443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:44.737210 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:44.737213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.737566 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.737567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:44.737679 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:44.738069 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:44.738076 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:44.739338 (+ 1262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:44.740681 (+ 1343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:44.740688 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:44.740691 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:44.741001 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:44.741198 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:44.741198 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:44.741199 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:44.741297 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:44.741564 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:44.741571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:44.741730 (+ 159us) client_negotiation.cc:769] Sending connection context
0809 16:15:44.741840 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 16:15:44.741998 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260809 16:15:44.742674 28886 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45999
I20260809 16:15:44.742759 28886 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:44.742928 28886 heartbeater.cc:511] Master 127.27.217.62:45999 requested a full tablet report, sending...
I20260809 16:15:44.743445 28598 ts_manager.cc:194] Registered new tserver with Master: fb3871128d66442982dd835b1766070d (127.27.217.1:35175)
I20260809 16:15:44.744092 28598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:46033
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:15:44.764704 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45999
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:44.844631 28896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:44.844811 28896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:44.844832 28896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:44.845924 28896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:44.845963 28896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:44.845991 28896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:15:44.847380 28896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:44.847590 28896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:44.847812 28896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:44.852370 28909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:44.852490 28896 server_base.cc:1034] running on GCE node
W20260809 16:15:44.852345 28912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:44.852353 28907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:44.852795 28896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:44.853049 28896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:44.854185 28896 hybrid_clock.cc:648] HybridClock initialized: now 1786292144854171 us; error 26 us; skew 500 ppm
Aug 09 16:15:44 dist-test-slave-nj21 krb5kdc[28530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:44.856577 28896 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:15:44.856989 28896 webserver.cc:460] Webserver started at http://127.27.217.2:45461/ using document root <none> and password file <none>
I20260809 16:15:44.857203 28896 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:44.857249 28896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:44.857368 28896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:44.858330 28896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "3c6e9b2849af46a4a269d17e454114a2"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "40ae3224657923fe86588fb9ab12b0f2"
server_key_iv: "0bfd611e54013bf0c572954f36a56aa6"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.858682 28896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "3c6e9b2849af46a4a269d17e454114a2"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "40ae3224657923fe86588fb9ab12b0f2"
server_key_iv: "0bfd611e54013bf0c572954f36a56aa6"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.859890 28896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:15:44.860559 28925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:44.860703 28896 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:44.860780 28896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "3c6e9b2849af46a4a269d17e454114a2"
format_stamp: "Formatted at 2026-08-09 16:15:44 on dist-test-slave-nj21"
server_key: "40ae3224657923fe86588fb9ab12b0f2"
server_key_iv: "0bfd611e54013bf0c572954f36a56aa6"
server_key_version: "encryptionkey@0"
I20260809 16:15:44.860841 28896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:44.871346 28896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:44.872892 28896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:44.873013 28896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:44.873196 28896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:44.873458 28896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:44.873489 28896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:44.873517 28896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:44.873533 28896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:44.879226 28896 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:34963
I20260809 16:15:44.879262 29082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:34963 every 8 connection(s)
I20260809 16:15:44.879532 28896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:15:44 dist-test-slave-nj21 krb5kdc[28530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:44.887283 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:44.880208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:52653 (local address 127.27.217.62:45999)
0809 16:15:44.880250 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:44.880252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:44.880464 (+ 212us) server_negotiation.cc:407] Connection header received
0809 16:15:44.880887 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:44.880888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:44.880896 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:44.880946 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:44.881782 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.882258 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.883150 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.883335 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.883375 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:44.885290 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:44.885292 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:44.885292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:44.885298 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:44.886313 (+ 1015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:44.886637 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:44.886638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:44.886638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:44.886680 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:44.886844 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:44.886845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:44.886845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:44.886935 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:44.886977 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:44.887163 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 16:15:44.887221 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:15:44.887428 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:44.880186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45999 (local address 127.27.217.2:52653)
0809 16:15:44.880347 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:44.880385 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:44.880816 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:44.881005 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:44.881008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:44.881538 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:44.881714 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:44.881718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.882317 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.882317 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:44.883091 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:44.883093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:44.883386 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:44.883387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:44.883478 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:44.883947 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:44.883955 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:44.885206 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:44.886371 (+ 1165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:44.886375 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:44.886377 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:44.886579 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:44.886721 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:44.886721 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:44.886722 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:44.886806 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:44.886974 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:44.886977 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:44.887075 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 16:15:44.887149 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 16:15:44.887257 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":73,"threads_started":1}
I20260809 16:15:44.887907 29084 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45999
I20260809 16:15:44.887990 29084 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:44.888144 29084 heartbeater.cc:511] Master 127.27.217.62:45999 requested a full tablet report, sending...
I20260809 16:15:44.888474 28598 ts_manager.cc:194] Registered new tserver with Master: 3c6e9b2849af46a4a269d17e454114a2 (127.27.217.2:34963)
I20260809 16:15:44.888813 28598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:52653
I20260809 16:15:44.889070 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 28896
I20260809 16:15:44.889158 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:15:44.889317 28516 external_mini_cluster.cc:1428] Setting key 6a84180e4f5309d4ac72a59381389ad8
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:15:44.912382 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45999
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:44.990939 29095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:44.991137 29095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:44.991168 29095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:44.992293 29095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:44.992334 29095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:44.992369 29095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:15:44.993774 29095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:44.993997 29095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:44.994199 29095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:44.998880 29102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:44.998994 29095 server_base.cc:1034] running on GCE node
W20260809 16:15:44.999003 29105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:44.998874 29103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:44.999281 29095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:44.999516 29095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:45.000658 29095 hybrid_clock.cc:648] HybridClock initialized: now 1786292145000642 us; error 30 us; skew 500 ppm
Aug 09 16:15:44 dist-test-slave-nj21 krb5kdc[28530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:45.002954 29095 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:15:45.003371 29095 webserver.cc:460] Webserver started at http://127.27.217.3:44031/ using document root <none> and password file <none>
I20260809 16:15:45.003568 29095 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:45.003614 29095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:45.003759 29095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:45.004730 29095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "16ea578690e24f26ac201c2d4d0e7f14"
format_stamp: "Formatted at 2026-08-09 16:15:45 on dist-test-slave-nj21"
server_key: "376ad3e1d8ce0ae6812436031a6d6af5"
server_key_iv: "7a22eddb7510dd98be4b22af59aa70f8"
server_key_version: "encryptionkey@0"
I20260809 16:15:45.005055 29095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "16ea578690e24f26ac201c2d4d0e7f14"
format_stamp: "Formatted at 2026-08-09 16:15:45 on dist-test-slave-nj21"
server_key: "376ad3e1d8ce0ae6812436031a6d6af5"
server_key_iv: "7a22eddb7510dd98be4b22af59aa70f8"
server_key_version: "encryptionkey@0"
I20260809 16:15:45.006331 29095 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:45.006976 29114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:45.007117 29095 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:45.007200 29095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "16ea578690e24f26ac201c2d4d0e7f14"
format_stamp: "Formatted at 2026-08-09 16:15:45 on dist-test-slave-nj21"
server_key: "376ad3e1d8ce0ae6812436031a6d6af5"
server_key_iv: "7a22eddb7510dd98be4b22af59aa70f8"
server_key_version: "encryptionkey@0"
I20260809 16:15:45.007262 29095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:45.016712 29095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:45.018586 29095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:45.018707 29095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:45.018879 29095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:45.019166 29095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:45.019198 29095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:45.019227 29095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:45.019249 29095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:45.024966 29095 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:43801
I20260809 16:15:45.025029 29282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:43801 every 8 connection(s)
I20260809 16:15:45.025271 29095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:15:45.026268 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29095
I20260809 16:15:45.026345 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:15:45.026507 28516 external_mini_cluster.cc:1428] Setting key 1d40f9cbf2e420ccab0e1c29304740df
Aug 09 16:15:45 dist-test-slave-nj21 krb5kdc[28530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292144, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:45.033703 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:45.025894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:40817 (local address 127.27.217.62:45999)
0809 16:15:45.025939 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:45.025941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:45.026148 (+ 207us) server_negotiation.cc:407] Connection header received
0809 16:15:45.026672 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:45.026674 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:45.026688 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:45.026756 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:45.027895 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:45.028373 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:45.029270 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:45.029465 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:45.029534 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:45.031457 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:45.031459 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:45.031459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:45.031466 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:45.032526 (+ 1060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:45.032858 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:45.032859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:45.032859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:45.032908 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:45.033126 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:45.033127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:45.033127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:45.033232 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:45.033286 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:45.033530 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 16:15:45.033617 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:15:45.033839 29287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:45.025869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45999 (local address 127.27.217.3:40817)
0809 16:15:45.026025 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:45.026065 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:45.026578 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:45.026825 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:45.026828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:45.027559 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:45.027814 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:45.027819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:45.028444 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:45.028445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:45.029212 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:45.029214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:45.029556 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:45.029558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:45.029689 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:45.030076 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:45.030083 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:45.031373 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:45.032591 (+ 1218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:45.032597 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:45.032599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:45.032796 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:45.032963 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:45.032963 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:45.032964 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:45.033071 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:45.033285 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:45.033291 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:45.033416 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 16:15:45.033500 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 16:15:45.033642 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260809 16:15:45.034232 29284 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45999
I20260809 16:15:45.034314 29284 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:45.034480 29284 heartbeater.cc:511] Master 127.27.217.62:45999 requested a full tablet report, sending...
I20260809 16:15:45.034806 28598 ts_manager.cc:194] Registered new tserver with Master: 16ea578690e24f26ac201c2d4d0e7f14 (127.27.217.3:43801)
I20260809 16:15:45.035136 28598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:40817
I20260809 16:15:45.038301 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 16:15:45 dist-test-slave-nj21 krb5kdc[28530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292145, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 16:15:45 dist-test-slave-nj21 krb5kdc[28530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292145, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:15:45.060365 29297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:45.053641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56584 (local address 127.27.217.1:35175)
0809 16:15:45.053781 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:45.053784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:45.053794 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:15:45.053818 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:45.053819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:45.053833 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:45.053893 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:45.054373 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:45.055065 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:45.055748 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:45.056055 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:45.056108 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:45.058045 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:45.058052 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:45.058052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:45.058059 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:45.059297 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:45.059613 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:45.059616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:45.059616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:45.059686 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:45.059853 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:45.059854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:45.059855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:45.059990 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:45.060142 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:45.060186 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 16:15:45.060259 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
W20260809 16:15:45.060720 28758 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56584
Aug 09 16:15:45 dist-test-slave-nj21 krb5kdc[28530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 16:15:45 dist-test-slave-nj21 krb5kdc[28530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:15:45.082603 29297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:45.076547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56586 (local address 127.27.217.1:35175)
0809 16:15:45.076609 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:45.076611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:45.076696 (+ 85us) server_negotiation.cc:407] Connection header received
0809 16:15:45.076776 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:45.076777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:45.076789 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:45.076835 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:45.077323 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:45.077796 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:45.078470 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:45.078670 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:45.078724 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:45.080685 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:45.080687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:45.080687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:45.080694 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:45.081803 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:45.082085 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:45.082086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:45.082086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:45.082131 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:45.082250 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:45.082250 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:45.082250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:45.082330 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:45.082405 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:45.082469 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 16:15:45.082527 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 16:15:45.083115 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 28687
I20260809 16:15:45.096697 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 28896
I20260809 16:15:45.104496 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29095
I20260809 16:15:45.113050 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 28552
2026-08-09T16:15:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1987 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:15:45 dist-test-slave-nj21 krb5kdc[29311](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:15:45 dist-test-slave-nj21 krb5kdc[29311](info): set up 2 sockets
Aug 09 16:15:45 dist-test-slave-nj21 krb5kdc[29311](info): commencing operation
krb5kdc: starting...
W20260809 16:15:46.263885 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:15:46 dist-test-slave-nj21 krb5kdc[29311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:15:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:15:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:15:46.375859 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:44119
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:41543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:44119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:46.454558 29332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:46.454757 29332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:46.454787 29332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:46.455915 29332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:15:46.455962 29332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:46.455979 29332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:46.455996 29332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:15:46.456010 29332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:15:46.457443 29332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:41543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:44119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:44119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:46.457687 29332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:46.457885 29332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:46.462409 29338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:46.462405 29342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:46.462457 29332 server_base.cc:1034] running on GCE node
W20260809 16:15:46.462430 29339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:46.462879 29332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:46.463153 29332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:46.464284 29332 hybrid_clock.cc:648] HybridClock initialized: now 1786292146464279 us; error 35 us; skew 500 ppm
Aug 09 16:15:46 dist-test-slave-nj21 krb5kdc[29311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:46.466519 29332 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:15:46.466939 29332 webserver.cc:460] Webserver started at http://127.27.217.62:33865/ using document root <none> and password file <none>
I20260809 16:15:46.467137 29332 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:46.467180 29332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:46.467303 29332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:46.468328 29332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "f1952defddad4472b3ffeb38a53324ef"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "adee6d4ccf25f2fab6721933c1d0d328"
server_key_iv: "bc8a9dc16974193e4fc3f65b973f34be"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.468641 29332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "f1952defddad4472b3ffeb38a53324ef"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "adee6d4ccf25f2fab6721933c1d0d328"
server_key_iv: "bc8a9dc16974193e4fc3f65b973f34be"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.469870 29332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:46.470567 29351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:46.470710 29332 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:46.470794 29332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "f1952defddad4472b3ffeb38a53324ef"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "adee6d4ccf25f2fab6721933c1d0d328"
server_key_iv: "bc8a9dc16974193e4fc3f65b973f34be"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.470851 29332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:46.498059 29332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:46.499897 29332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:46.500039 29332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:46.503805 29332 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:44119
I20260809 16:15:46.503912 29429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:44119 every 8 connection(s)
I20260809 16:15:46.504170 29332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:15:46.505007 29431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:46.507200 29431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef: Bootstrap starting.
I20260809 16:15:46.507743 29431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:46.507970 29431 log.cc:824] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:46.508591 29431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef: No bootstrap required, opened a new log
I20260809 16:15:46.510073 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29332
I20260809 16:15:46.510160 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:15:46.510320 28516 external_mini_cluster.cc:1428] Setting key 87c44766e50fd8d09c583319ebfaf902
I20260809 16:15:46.510243 29431 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1952defddad4472b3ffeb38a53324ef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 44119 } }
I20260809 16:15:46.510408 29431 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:46.510450 29431 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1952defddad4472b3ffeb38a53324ef, State: Initialized, Role: FOLLOWER
I20260809 16:15:46.510571 29431 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1952defddad4472b3ffeb38a53324ef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 44119 } }
I20260809 16:15:46.510622 29431 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:15:46.510645 29431 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:15:46.510684 29431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:46.511582 29431 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1952defddad4472b3ffeb38a53324ef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 44119 } }
I20260809 16:15:46.511724 29431 leader_election.cc:302] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1952defddad4472b3ffeb38a53324ef; no voters:
I20260809 16:15:46.511893 29431 leader_election.cc:288] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:15:46.511938 29436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:46.512070 29436 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [term 1 LEADER]: Becoming Leader. State: Replica: f1952defddad4472b3ffeb38a53324ef, State: Running, Role: LEADER
I20260809 16:15:46.512166 29431 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:15:46.512154 29436 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1952defddad4472b3ffeb38a53324ef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 44119 } }
I20260809 16:15:46.512580 29438 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1952defddad4472b3ffeb38a53324ef. Latest consensus state: current_term: 1 leader_uuid: "f1952defddad4472b3ffeb38a53324ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1952defddad4472b3ffeb38a53324ef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 44119 } } }
I20260809 16:15:46.512670 29438 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:46.512832 29437 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1952defddad4472b3ffeb38a53324ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1952defddad4472b3ffeb38a53324ef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 44119 } } }
I20260809 16:15:46.512874 29437 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:46.512979 29445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:15:46.513381 29445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:15:46.514799 29445 catalog_manager.cc:1347] Generated new cluster ID: 751da32f02e3422297eb070aa52e625a
I20260809 16:15:46.514847 29445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:15:46 dist-test-slave-nj21 krb5kdc[29311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:46.521565 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:46.510790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59198 (local address 127.27.217.62:44119)
0809 16:15:46.511014 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:46.511022 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:46.511047 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:15:46.511148 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:46.511153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:46.511193 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:46.511295 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:46.512107 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.513455 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.514321 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.514892 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.514998 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:46.517650 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:46.517654 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:46.517654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:46.517665 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:46.520017 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:46.520406 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:46.520409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:46.520409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:46.520519 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:46.520706 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:46.520706 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:46.520707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:46.520969 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:46.521110 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:46.521219 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 16:15:46.521342 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
I20260809 16:15:46.525368 29445 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:15:46.526027 29445 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:15:46.536083 29445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1952defddad4472b3ffeb38a53324ef: Generated new TSK 0
I20260809 16:15:46.536249 29445 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:15:46.563449 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:44119
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:41543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:46.642760 29468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:46.642951 29468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:46.642971 29468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:46.644073 29468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:46.644106 29468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:46.644131 29468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:15:46.645570 29468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:41543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:44119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:46.645756 29468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:46.645926 29468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:46.650518 29477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:46.650647 29484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:46.650786 29468 server_base.cc:1034] running on GCE node
W20260809 16:15:46.650815 29479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:46.651038 29468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:46.651233 29468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:46.652364 29468 hybrid_clock.cc:648] HybridClock initialized: now 1786292146652345 us; error 33 us; skew 500 ppm
Aug 09 16:15:46 dist-test-slave-nj21 krb5kdc[29311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:46.654731 29468 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:15:46.655140 29468 webserver.cc:460] Webserver started at http://127.27.217.1:35679/ using document root <none> and password file <none>
I20260809 16:15:46.655351 29468 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:46.655400 29468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:46.655522 29468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:46.656548 29468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "80241d5352b747b6ab7fd090bf927746"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "d8a2d90e96cefb7b0d89fe7d7a2a67c9"
server_key_iv: "c4dc508729cd3d5297620ff70a367267"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.656873 29468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "80241d5352b747b6ab7fd090bf927746"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "d8a2d90e96cefb7b0d89fe7d7a2a67c9"
server_key_iv: "c4dc508729cd3d5297620ff70a367267"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.658054 29468 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:46.658679 29496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:46.658823 29468 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:46.658905 29468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "80241d5352b747b6ab7fd090bf927746"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "d8a2d90e96cefb7b0d89fe7d7a2a67c9"
server_key_iv: "c4dc508729cd3d5297620ff70a367267"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.658977 29468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:46.681958 29468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:46.683609 29468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:46.683764 29468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:46.683987 29468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:46.684278 29468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:46.684312 29468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:46.684342 29468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:46.684360 29468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:46.689781 29468 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:33211
I20260809 16:15:46.689844 29676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:33211 every 8 connection(s)
I20260809 16:15:46.690125 29468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
Aug 09 16:15:46 dist-test-slave-nj21 krb5kdc[29311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:46.698228 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:46.690774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:41585 (local address 127.27.217.62:44119)
0809 16:15:46.690832 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:46.690835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:46.691049 (+ 214us) server_negotiation.cc:407] Connection header received
0809 16:15:46.691988 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:46.691989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:46.692002 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:46.692054 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:46.692604 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.693099 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.693990 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.694173 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.694216 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:46.696128 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:46.696129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:46.696130 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:46.696139 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:46.697233 (+ 1094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:46.697556 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:46.697557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:46.697557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:46.697602 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:46.697766 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:46.697766 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:46.697767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:46.697859 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:46.697902 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:46.698102 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 16:15:46.698162 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:15:46.698252 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29468
I20260809 16:15:46.698334 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:15:46.698460 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:46.690746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:44119 (local address 127.27.217.1:41585)
0809 16:15:46.690930 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:46.690972 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:46.691900 (+ 928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:46.692114 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:46.692117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:46.692355 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:46.692544 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:46.692548 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.693156 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.693157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:46.693932 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:46.693933 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.694222 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.694223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:46.694313 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:46.694740 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:46.694748 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:46.696047 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:46.697294 (+ 1247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:46.697299 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:46.697300 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:46.697503 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:46.697644 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:46.697644 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:46.697645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:46.697727 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:46.697897 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:46.697900 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:46.698006 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 16:15:46.698093 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 16:15:46.698248 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260809 16:15:46.698504 28516 external_mini_cluster.cc:1428] Setting key f288f324bce4d15127a3d45750004de3
I20260809 16:15:46.698946 29679 heartbeater.cc:347] Connected to a master server at 127.27.217.62:44119
I20260809 16:15:46.699023 29679 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:46.699177 29679 heartbeater.cc:511] Master 127.27.217.62:44119 requested a full tablet report, sending...
I20260809 16:15:46.699720 29376 ts_manager.cc:194] Registered new tserver with Master: 80241d5352b747b6ab7fd090bf927746 (127.27.217.1:33211)
I20260809 16:15:46.700521 29376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:41585
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:15:46.721994 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:44119
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:41543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:46.800510 29684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:46.800694 29684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:46.800724 29684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:46.801786 29684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:46.801817 29684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:46.801842 29684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:15:46.803239 29684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:41543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:44119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:46.803416 29684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:46.803581 29684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:46.808113 29696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:46.808128 29689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:46.808219 29684 server_base.cc:1034] running on GCE node
W20260809 16:15:46.808225 29690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:46.808539 29684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:46.808754 29684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:46.809886 29684 hybrid_clock.cc:648] HybridClock initialized: now 1786292146809873 us; error 30 us; skew 500 ppm
Aug 09 16:15:46 dist-test-slave-nj21 krb5kdc[29311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:46.812291 29684 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:15:46.812645 29684 webserver.cc:460] Webserver started at http://127.27.217.2:41733/ using document root <none> and password file <none>
I20260809 16:15:46.812834 29684 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:46.812899 29684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:46.813040 29684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:46.813994 29684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "634a17977cfd48ce925c34518f0f0c64"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "3c1f3a3feac199198d5fd91ec666f152"
server_key_iv: "ebcde70446a18aa2301722644d82071f"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.814270 29684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "634a17977cfd48ce925c34518f0f0c64"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "3c1f3a3feac199198d5fd91ec666f152"
server_key_iv: "ebcde70446a18aa2301722644d82071f"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.815490 29684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:46.816341 29708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:46.816500 29684 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:46.816599 29684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "634a17977cfd48ce925c34518f0f0c64"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "3c1f3a3feac199198d5fd91ec666f152"
server_key_iv: "ebcde70446a18aa2301722644d82071f"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.816670 29684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:46.836762 29684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:46.838762 29684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:46.838871 29684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:46.839056 29684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:46.839293 29684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:46.839321 29684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:46.839341 29684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:46.839357 29684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:46.844784 29684 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:38631
I20260809 16:15:46.844848 29876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:38631 every 8 connection(s)
I20260809 16:15:46.845124 29684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:15:46.846040 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29684
I20260809 16:15:46.846114 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:15:46.846268 28516 external_mini_cluster.cc:1428] Setting key 16351015c0ebb333a775f334ec4cdb78
Aug 09 16:15:46 dist-test-slave-nj21 krb5kdc[29311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:46.854396 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:46.845772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:54881 (local address 127.27.217.62:44119)
0809 16:15:46.845854 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:46.845856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:46.846027 (+ 171us) server_negotiation.cc:407] Connection header received
0809 16:15:46.847122 (+ 1095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:46.847123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:46.847134 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:46.847204 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:46.847869 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.848368 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.849406 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.849664 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.849733 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:46.851884 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:46.851886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:46.851886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:46.851892 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:46.853111 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:46.853538 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:46.853539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:46.853539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:46.853585 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:46.853828 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:46.853829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:46.853829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:46.853922 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:46.853968 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:46.854269 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 16:15:46.854331 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
I20260809 16:15:46.854638 29880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:46.845747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:44119 (local address 127.27.217.2:54881)
0809 16:15:46.845911 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:46.845946 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:46.847033 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:46.847278 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:46.847282 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:46.847544 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:46.847784 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:46.847789 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.848474 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.848475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:46.849324 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:46.849327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:46.849738 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:46.849739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:46.849838 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:46.850277 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:46.850285 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:46.851800 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:46.853189 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:46.853195 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:46.853197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:46.853470 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:46.853639 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:46.853639 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:46.853640 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:46.853771 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:46.853979 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:46.853984 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:46.854147 (+ 163us) client_negotiation.cc:769] Sending connection context
0809 16:15:46.854259 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 16:15:46.854414 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":86,"threads_started":1}
I20260809 16:15:46.855113 29877 heartbeater.cc:347] Connected to a master server at 127.27.217.62:44119
I20260809 16:15:46.855199 29877 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:46.855365 29877 heartbeater.cc:511] Master 127.27.217.62:44119 requested a full tablet report, sending...
I20260809 16:15:46.855736 29376 ts_manager.cc:194] Registered new tserver with Master: 634a17977cfd48ce925c34518f0f0c64 (127.27.217.2:38631)
I20260809 16:15:46.856109 29376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:54881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:15:46.870483 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:44119
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:41543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:46.948437 29885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:46.948632 29885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:46.948668 29885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:46.949793 29885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:46.949834 29885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:46.949868 29885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:15:46.951301 29885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:41543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:44119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:46.951519 29885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:46.951740 29885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:46.956332 29894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:46.956334 29890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:46.956369 29891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:46.956411 29885 server_base.cc:1034] running on GCE node
I20260809 16:15:46.956728 29885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:46.956916 29885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:46.958046 29885 hybrid_clock.cc:648] HybridClock initialized: now 1786292146958032 us; error 33 us; skew 500 ppm
Aug 09 16:15:46 dist-test-slave-nj21 krb5kdc[29311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:46.960464 29885 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:15:46.960819 29885 webserver.cc:460] Webserver started at http://127.27.217.3:43539/ using document root <none> and password file <none>
I20260809 16:15:46.960985 29885 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:46.961023 29885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:46.961112 29885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:46.962096 29885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "2ad50064452f4d62902e4634d80d6022"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "6c992324d9294dd4db00705e27c64df0"
server_key_iv: "561ea69dff032c6d9c39bc577f21c025"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.962478 29885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "2ad50064452f4d62902e4634d80d6022"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "6c992324d9294dd4db00705e27c64df0"
server_key_iv: "561ea69dff032c6d9c39bc577f21c025"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.963758 29885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:15:46.964483 29903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:46.964635 29885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:15:46.964722 29885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "2ad50064452f4d62902e4634d80d6022"
format_stamp: "Formatted at 2026-08-09 16:15:46 on dist-test-slave-nj21"
server_key: "6c992324d9294dd4db00705e27c64df0"
server_key_iv: "561ea69dff032c6d9c39bc577f21c025"
server_key_version: "encryptionkey@0"
I20260809 16:15:46.964787 29885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:47.004117 29885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:47.006244 29885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:47.006382 29885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:47.006618 29885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:47.006912 29885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:47.006944 29885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:47.006968 29885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:47.006990 29885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:47.012698 29885 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:39173
I20260809 16:15:47.012787 30081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:39173 every 8 connection(s)
I20260809 16:15:47.013247 29885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:15:47.014809 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29885
I20260809 16:15:47.014891 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:15:47.015035 28516 external_mini_cluster.cc:1428] Setting key 46b3090ef30367fef12a5a740dec67da
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[29311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:47.022248 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.014169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:41273 (local address 127.27.217.62:44119)
0809 16:15:47.014208 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.014210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.014409 (+ 199us) server_negotiation.cc:407] Connection header received
0809 16:15:47.015430 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.015432 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.015445 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.015495 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:47.016145 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.016642 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.017602 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.017796 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.017850 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.019901 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:47.019902 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:47.019902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:47.019909 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:47.021032 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.021387 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.021388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.021388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.021442 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.021654 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.021655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.021656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.021762 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:47.021820 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.022069 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.022158 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:15:47.022392 30086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.014150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:44119 (local address 127.27.217.3:41273)
0809 16:15:47.014297 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:47.014331 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:47.015338 (+ 1007us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:47.015563 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:47.015567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:47.015870 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:47.016059 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.016064 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.016720 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.016721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.017521 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.017523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.017864 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.017865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.017999 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.018372 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:47.018380 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:47.019813 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:47.021103 (+ 1290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:47.021110 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:47.021112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:47.021320 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:47.021496 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:47.021497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:47.021497 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:47.021600 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:47.021818 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:47.021825 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:47.021953 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 16:15:47.022039 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 16:15:47.022187 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260809 16:15:47.022812 30082 heartbeater.cc:347] Connected to a master server at 127.27.217.62:44119
I20260809 16:15:47.022897 30082 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:47.023072 30082 heartbeater.cc:511] Master 127.27.217.62:44119 requested a full tablet report, sending...
I20260809 16:15:47.023398 29376 ts_manager.cc:194] Registered new tserver with Master: 2ad50064452f4d62902e4634d80d6022 (127.27.217.3:39173)
I20260809 16:15:47.023772 29376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:41273
I20260809 16:15:47.026475 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:15:47.033064 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.027896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59210 (local address 127.27.217.62:44119)
0809 16:15:47.027935 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.027937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.028027 (+ 90us) server_negotiation.cc:407] Connection header received
0809 16:15:47.028073 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.028074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.028081 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.028122 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:47.028593 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.029074 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.029805 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.029987 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.030038 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.031019 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:47.031020 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:47.031020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:47.031025 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:47.032268 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.032525 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.032526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.032526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.032566 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.032677 (+ 111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.032677 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.032678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.032799 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:47.032865 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.032942 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.032997 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:15:47.034837 29376 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59210:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:15:47.036653 29376 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:47.042738 30099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.039011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:33211 (local address 127.0.0.1:51672)
0809 16:15:47.039176 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:47.039188 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:47.039239 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:47.039565 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:47.039566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:47.039568 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:47.039615 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.039616 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.040996 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.040997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.041772 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.041775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.042451 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.042452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.042530 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.042543 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 16:15:47.042608 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 16:15:47.042661 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":2,"thread_start_us":80,"threads_started":1}
I20260809 16:15:47.042749 30107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.039250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51672 (local address 127.27.217.1:33211)
0809 16:15:47.039412 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.039416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.039425 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:15:47.039460 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.039462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.039475 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.039557 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:47.039711 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.040902 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.041858 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.042370 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.042445 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.042507 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.042629 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.042671 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260809 16:15:47.043125 30101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.038825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:38631 (local address 127.0.0.1:37222)
0809 16:15:47.038966 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:47.039010 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:47.039074 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:47.039510 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:47.039512 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:47.039514 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:47.039576 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.039578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.040572 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.040573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.041782 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.041785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.042750 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.042751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.042956 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.042960 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:15:47.043013 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:15:47.043053 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":1,"thread_start_us":81,"threads_started":1}
I20260809 16:15:47.043175 30103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.039010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37222 (local address 127.27.217.2:38631)
0809 16:15:47.039281 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.039286 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.039296 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:15:47.039336 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.039337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.039353 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.039422 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:47.039654 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.040484 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.041886 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.042593 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.042659 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.042714 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.043043 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.043093 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":76,"threads_started":1}
I20260809 16:15:47.043371 30106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.038825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:39173 (local address 127.0.0.1:35920)
0809 16:15:47.039125 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:47.039134 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:47.039173 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:47.039511 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:47.039518 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:47.039520 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:47.039582 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.039584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.040879 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.040880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.041927 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.041929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.042810 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.042811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.043054 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.043057 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:15:47.043099 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 16:15:47.043127 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":3,"thread_start_us":48,"threads_started":1}
I20260809 16:15:47.043555 30102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.038917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35920 (local address 127.27.217.3:39173)
0809 16:15:47.039274 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.039279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.039289 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:15:47.039324 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.039326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.039340 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.039410 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:47.039656 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.040766 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.042005 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.042679 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.042734 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.042782 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.043168 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.043475 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":93,"threads_started":1}
I20260809 16:15:47.043466 29580 tablet_service.cc:1467] Processing CreateTablet for tablet a7809727caff40e4936c75438311bc09 (DEFAULT_TABLE table=test-table [id=ea46ef4b1d19458d9930329794ede895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:47.043879 29580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7809727caff40e4936c75438311bc09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:47.043927 29774 tablet_service.cc:1467] Processing CreateTablet for tablet a7809727caff40e4936c75438311bc09 (DEFAULT_TABLE table=test-table [id=ea46ef4b1d19458d9930329794ede895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:47.044134 29977 tablet_service.cc:1467] Processing CreateTablet for tablet a7809727caff40e4936c75438311bc09 (DEFAULT_TABLE table=test-table [id=ea46ef4b1d19458d9930329794ede895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:47.044269 29774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7809727caff40e4936c75438311bc09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:47.044450 29977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7809727caff40e4936c75438311bc09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:47.046803 30108 tablet_bootstrap.cc:492] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022: Bootstrap starting.
I20260809 16:15:47.047297 30110 tablet_bootstrap.cc:492] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64: Bootstrap starting.
I20260809 16:15:47.047809 30111 tablet_bootstrap.cc:492] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746: Bootstrap starting.
I20260809 16:15:47.047839 30108 tablet_bootstrap.cc:654] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:47.047895 30110 tablet_bootstrap.cc:654] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:47.048343 30111 tablet_bootstrap.cc:654] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:47.048395 30108 log.cc:824] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:47.048429 30110 log.cc:824] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:47.048889 30111 log.cc:824] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:47.049270 30108 tablet_bootstrap.cc:492] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022: No bootstrap required, opened a new log
I20260809 16:15:47.049345 30110 tablet_bootstrap.cc:492] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64: No bootstrap required, opened a new log
I20260809 16:15:47.049343 30108 ts_tablet_manager.cc:1397] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 16:15:47.049403 30110 ts_tablet_manager.cc:1397] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:47.049582 30111 tablet_bootstrap.cc:492] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746: No bootstrap required, opened a new log
I20260809 16:15:47.049640 30111 ts_tablet_manager.cc:1397] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:47.051210 30111 raft_consensus.cc:348] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.051347 30111 raft_consensus.cc:374] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:47.051381 30111 raft_consensus.cc:729] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80241d5352b747b6ab7fd090bf927746, State: Initialized, Role: FOLLOWER
I20260809 16:15:47.051514 30111 consensus_queue.cc:260] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.051453 30108 raft_consensus.cc:348] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.051453 30110 raft_consensus.cc:348] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.051623 30110 raft_consensus.cc:374] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:47.051620 30108 raft_consensus.cc:374] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:47.051664 30110 raft_consensus.cc:729] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 634a17977cfd48ce925c34518f0f0c64, State: Initialized, Role: FOLLOWER
I20260809 16:15:47.051664 30108 raft_consensus.cc:729] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad50064452f4d62902e4634d80d6022, State: Initialized, Role: FOLLOWER
I20260809 16:15:47.051818 30111 ts_tablet_manager.cc:1428] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:15:47.051812 30108 consensus_queue.cc:260] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.051812 30110 consensus_queue.cc:260] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.051961 29679 heartbeater.cc:503] Master 127.27.217.62:44119 was elected leader, sending a full tablet report...
I20260809 16:15:47.052096 29877 heartbeater.cc:503] Master 127.27.217.62:44119 was elected leader, sending a full tablet report...
I20260809 16:15:47.052098 30110 ts_tablet_manager.cc:1428] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260809 16:15:47.052474 30082 heartbeater.cc:503] Master 127.27.217.62:44119 was elected leader, sending a full tablet report...
I20260809 16:15:47.052471 30108 ts_tablet_manager.cc:1428] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
W20260809 16:15:47.095732 29878 tablet.cc:2369] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:15:47.174925 30119 raft_consensus.cc:482] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:47.175055 30119 raft_consensus.cc:504] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.175441 30119 leader_election.cc:288] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 634a17977cfd48ce925c34518f0f0c64 (127.27.217.2:38631), 80241d5352b747b6ab7fd090bf927746 (127.27.217.1:33211)
I20260809 16:15:47.179075 30107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.175806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:36003 (local address 127.27.217.1:33211)
0809 16:15:47.175855 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.175857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.176027 (+ 170us) server_negotiation.cc:407] Connection header received
0809 16:15:47.176070 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.176072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.176084 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.176136 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:47.176248 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.176913 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.178173 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.178712 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.178784 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.178794 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.178964 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.179004 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:15:47.179075 30103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.175738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:56793 (local address 127.27.217.2:38631)
0809 16:15:47.175789 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.175792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.175800 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:15:47.175828 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.175828 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.175842 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.175897 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:47.176078 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.176836 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.178176 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.178736 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.178796 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.178803 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.178965 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.179002 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:15:47.179083 30086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.175610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:38631 (local address 127.27.217.3:56793)
0809 16:15:47.175665 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:47.175698 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:47.175760 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:47.175931 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:47.175932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:47.175934 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:47.176012 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.176014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.176913 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.176913 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.178096 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.178099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.178800 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.178800 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.178895 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.178897 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:15:47.178956 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 16:15:47.178986 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":16}
I20260809 16:15:47.179090 30120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.175759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:33211 (local address 127.27.217.3:36003)
0809 16:15:47.175954 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:47.175964 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:47.176023 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:47.176147 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:47.176147 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:47.176149 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:47.176196 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.176197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.176984 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.176984 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.178099 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:47.178100 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.178799 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.178800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:47.178892 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.178896 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:15:47.178946 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 16:15:47.178986 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":3,"thread_start_us":115,"threads_started":1}
I20260809 16:15:47.179436 29601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7809727caff40e4936c75438311bc09" candidate_uuid: "2ad50064452f4d62902e4634d80d6022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80241d5352b747b6ab7fd090bf927746" is_pre_election: true
I20260809 16:15:47.179450 29799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7809727caff40e4936c75438311bc09" candidate_uuid: "2ad50064452f4d62902e4634d80d6022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "634a17977cfd48ce925c34518f0f0c64" is_pre_election: true
I20260809 16:15:47.179595 29799 raft_consensus.cc:2454] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ad50064452f4d62902e4634d80d6022 in term 0.
I20260809 16:15:47.179595 29601 raft_consensus.cc:2454] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ad50064452f4d62902e4634d80d6022 in term 0.
I20260809 16:15:47.179842 29905 leader_election.cc:302] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad50064452f4d62902e4634d80d6022, 80241d5352b747b6ab7fd090bf927746; no voters:
I20260809 16:15:47.180004 30119 raft_consensus.cc:2781] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:47.180060 30119 raft_consensus.cc:482] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:47.180083 30119 raft_consensus.cc:3037] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:47.180792 30119 raft_consensus.cc:504] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.180907 30119 leader_election.cc:288] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [CANDIDATE]: Term 1 election: Requested vote from peers 634a17977cfd48ce925c34518f0f0c64 (127.27.217.2:38631), 80241d5352b747b6ab7fd090bf927746 (127.27.217.1:33211)
I20260809 16:15:47.181077 29601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7809727caff40e4936c75438311bc09" candidate_uuid: "2ad50064452f4d62902e4634d80d6022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80241d5352b747b6ab7fd090bf927746"
I20260809 16:15:47.181082 29799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7809727caff40e4936c75438311bc09" candidate_uuid: "2ad50064452f4d62902e4634d80d6022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "634a17977cfd48ce925c34518f0f0c64"
I20260809 16:15:47.181142 29799 raft_consensus.cc:3037] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:47.181145 29601 raft_consensus.cc:3037] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:47.181811 29601 raft_consensus.cc:2454] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ad50064452f4d62902e4634d80d6022 in term 1.
I20260809 16:15:47.181852 29799 raft_consensus.cc:2454] T a7809727caff40e4936c75438311bc09 P 634a17977cfd48ce925c34518f0f0c64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ad50064452f4d62902e4634d80d6022 in term 1.
I20260809 16:15:47.181977 29905 leader_election.cc:302] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad50064452f4d62902e4634d80d6022, 634a17977cfd48ce925c34518f0f0c64; no voters:
I20260809 16:15:47.182066 30119 raft_consensus.cc:2781] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:47.182214 30119 raft_consensus.cc:686] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [term 1 LEADER]: Becoming Leader. State: Replica: 2ad50064452f4d62902e4634d80d6022, State: Running, Role: LEADER
I20260809 16:15:47.182293 30119 consensus_queue.cc:237] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } }
I20260809 16:15:47.183133 29376 catalog_manager.cc:5495] T a7809727caff40e4936c75438311bc09 P 2ad50064452f4d62902e4634d80d6022 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ad50064452f4d62902e4634d80d6022 (127.27.217.3). New cstate: current_term: 1 leader_uuid: "2ad50064452f4d62902e4634d80d6022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "634a17977cfd48ce925c34518f0f0c64" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ad50064452f4d62902e4634d80d6022" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80241d5352b747b6ab7fd090bf927746" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 33211 } health_report { overall_health: UNKNOWN } } }
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[29311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
W20260809 16:15:47.190752 29680 tablet.cc:2369] T a7809727caff40e4936c75438311bc09 P 80241d5352b747b6ab7fd090bf927746: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:15:47.192679 30107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.185984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51678 (local address 127.27.217.1:33211)
0809 16:15:47.186041 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.186043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.186138 (+ 95us) server_negotiation.cc:407] Connection header received
0809 16:15:47.186200 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.186201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.186209 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.186257 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:47.186792 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.187244 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.187959 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.188154 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.188207 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.190332 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:47.190339 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:47.190339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:47.190345 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:47.191870 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.192158 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.192160 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.192160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.192210 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.192331 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.192331 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.192331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.192439 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:47.192536 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.192565 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.192620 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[29311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292147, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[29311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292147, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:15:47.214401 30107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.208345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51680 (local address 127.27.217.1:33211)
0809 16:15:47.208405 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.208407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.208454 (+ 47us) server_negotiation.cc:407] Connection header received
0809 16:15:47.208517 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.208518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.208527 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.208575 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:47.209085 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.209566 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.210255 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.210448 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.210501 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.212491 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:47.212492 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:47.212492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:47.212499 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:47.213595 (+ 1096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.213871 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.213872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.213872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.213921 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.214041 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.214041 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.214041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.214118 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:47.214181 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.214283 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.214337 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[29311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[29311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:15:47.234705 30107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:47.229062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51694 (local address 127.27.217.1:33211)
0809 16:15:47.229120 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:47.229122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:47.229175 (+ 53us) server_negotiation.cc:407] Connection header received
0809 16:15:47.229222 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:47.229223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:47.229231 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:47.229276 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:47.229743 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.230191 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.230820 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:47.230986 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:47.231027 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:47.232926 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:47.232927 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:47.232927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:47.232933 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:47.233946 (+ 1013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.234213 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.234213 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.234214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.234254 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:47.234369 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:47.234369 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:47.234370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:47.234456 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:47.234518 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:47.234589 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 16:15:47.234639 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 16:15:47.235152 29545 tablet_service.cc:2908] Rejecting scan request for tablet a7809727caff40e4936c75438311bc09: Uninitialized: clean time has not yet been initialized
I20260809 16:15:47.235913 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29468
I20260809 16:15:47.242884 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29684
I20260809 16:15:47.260347 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29885
I20260809 16:15:47.271344 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29332
2026-08-09T16:15:47Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2154 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[30146](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[30146](info): set up 2 sockets
Aug 09 16:15:47 dist-test-slave-nj21 krb5kdc[30146](info): commencing operation
krb5kdc: starting...
W20260809 16:15:48.412456 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:15:48 dist-test-slave-nj21 krb5kdc[30146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:15:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:15:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:15:48.524077 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:33599
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:33599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:48.602180 30167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:48.602366 30167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:48.602386 30167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:48.603441 30167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:15:48.603474 30167 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 16:15:48.603487 30167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:48.603497 30167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:48.603518 30167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:15:48.603530 30167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:15:48.604925 30167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:33599
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:33599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:48.605104 30167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:48.605268 30167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:48.609911 30181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:48.609858 30178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:48.609853 30174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:48.609923 30167 server_base.cc:1034] running on GCE node
I20260809 16:15:48.610314 30167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:48.610576 30167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:48.611728 30167 hybrid_clock.cc:648] HybridClock initialized: now 1786292148611713 us; error 28 us; skew 500 ppm
Aug 09 16:15:48 dist-test-slave-nj21 krb5kdc[30146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292148, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:48.618135 30167 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:15:48.618543 30167 webserver.cc:460] Webserver started at http://127.27.217.62:40275/ using document root <none> and password file <none>
I20260809 16:15:48.618764 30167 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:48.618811 30167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:48.618952 30167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:48.620031 30167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "a602de5676454bf49d6fb3849cd4a37f"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "8fcffda878166fab2b83a9a516a6e94b"
server_key_iv: "b2f12b8d123a9eae49e65309e9c72a8c"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.620359 30167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "a602de5676454bf49d6fb3849cd4a37f"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "8fcffda878166fab2b83a9a516a6e94b"
server_key_iv: "b2f12b8d123a9eae49e65309e9c72a8c"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.621582 30167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:48.622211 30196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:48.622419 30167 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:48.622511 30167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "a602de5676454bf49d6fb3849cd4a37f"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "8fcffda878166fab2b83a9a516a6e94b"
server_key_iv: "b2f12b8d123a9eae49e65309e9c72a8c"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.622571 30167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:48.630113 30167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:48.631704 30167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:48.631834 30167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:48.636315 30167 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:33599
I20260809 16:15:48.636420 30287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:33599 every 8 connection(s)
I20260809 16:15:48.636672 30167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:15:48.637311 30288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:48.638259 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30167
I20260809 16:15:48.638338 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:15:48.638521 28516 external_mini_cluster.cc:1428] Setting key a5e5d782523c458101a9838f3c8cc361
I20260809 16:15:48.639972 30288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f: Bootstrap starting.
I20260809 16:15:48.640601 30288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:48.640897 30288 log.cc:824] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:48.641623 30288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f: No bootstrap required, opened a new log
I20260809 16:15:48.643651 30288 raft_consensus.cc:348] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a602de5676454bf49d6fb3849cd4a37f" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33599 } }
I20260809 16:15:48.643812 30288 raft_consensus.cc:374] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:48.643837 30288 raft_consensus.cc:729] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a602de5676454bf49d6fb3849cd4a37f, State: Initialized, Role: FOLLOWER
I20260809 16:15:48.643956 30288 consensus_queue.cc:260] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a602de5676454bf49d6fb3849cd4a37f" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33599 } }
I20260809 16:15:48.644021 30288 raft_consensus.cc:388] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:15:48.644043 30288 raft_consensus.cc:482] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:15:48.644089 30288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:48.644616 30288 raft_consensus.cc:504] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a602de5676454bf49d6fb3849cd4a37f" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33599 } }
I20260809 16:15:48.644726 30288 leader_election.cc:302] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a602de5676454bf49d6fb3849cd4a37f; no voters:
I20260809 16:15:48.644879 30288 leader_election.cc:288] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:15:48.644915 30295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:48.645077 30295 raft_consensus.cc:686] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [term 1 LEADER]: Becoming Leader. State: Replica: a602de5676454bf49d6fb3849cd4a37f, State: Running, Role: LEADER
I20260809 16:15:48.645123 30288 sys_catalog.cc:564] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 16:15:48 dist-test-slave-nj21 krb5kdc[30146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:48.645217 30295 consensus_queue.cc:237] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a602de5676454bf49d6fb3849cd4a37f" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33599 } }
I20260809 16:15:48.645711 30300 sys_catalog.cc:455] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a602de5676454bf49d6fb3849cd4a37f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a602de5676454bf49d6fb3849cd4a37f" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33599 } } }
I20260809 16:15:48.645723 30296 sys_catalog.cc:455] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a602de5676454bf49d6fb3849cd4a37f. Latest consensus state: current_term: 1 leader_uuid: "a602de5676454bf49d6fb3849cd4a37f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a602de5676454bf49d6fb3849cd4a37f" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33599 } } }
I20260809 16:15:48.645843 30300 sys_catalog.cc:458] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:48.645849 30296 sys_catalog.cc:458] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:48.646173 30311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:15:48.647050 30311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:15:48.648613 30311 catalog_manager.cc:1347] Generated new cluster ID: 2449593f49854e969a1fbdd0de4f2501
I20260809 16:15:48.648664 30311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:15:48.649358 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.638997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47250 (local address 127.27.217.62:33599)
0809 16:15:48.639182 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:48.639192 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:48.639224 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:15:48.639718 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:48.639728 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:48.639788 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:48.639942 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:48.640483 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.641775 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.642477 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.643117 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.643220 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.645703 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:48.645707 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:48.645707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:48.645718 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:48.647713 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.648132 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.648134 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.648134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.648219 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.648458 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.648459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.648459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.648759 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:48.648908 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:48.649030 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 16:15:48.649167 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260809 16:15:48.653883 30311 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:15:48.654559 30311 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:15:48.667532 30311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f: Generated new TSK 0
I20260809 16:15:48.667765 30311 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:15:48.694993 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33599
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:48.774583 30332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:48.774775 30332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:48.774796 30332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:48.775955 30332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:48.775995 30332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:48.776016 30332 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:15:48.776046 30332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:15:48.777441 30332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:33599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:48.777660 30332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:48.777856 30332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:48.782555 30339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:48.782532 30344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:48.782611 30332 server_base.cc:1034] running on GCE node
W20260809 16:15:48.782549 30340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:48.782871 30332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:48.783084 30332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:48.784217 30332 hybrid_clock.cc:648] HybridClock initialized: now 1786292148784199 us; error 32 us; skew 500 ppm
Aug 09 16:15:48 dist-test-slave-nj21 krb5kdc[30146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292148, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:48.786623 30332 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:15:48.787051 30332 webserver.cc:460] Webserver started at http://127.27.217.1:39949/ using document root <none> and password file <none>
I20260809 16:15:48.787250 30332 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:48.787308 30332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:48.787437 30332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:48.788465 30332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "a1504d00ee0e64b3e5cfaed3242ac958"
server_key_iv: "726e49c4913196bb7dc613bc513b8b18"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.788801 30332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "a1504d00ee0e64b3e5cfaed3242ac958"
server_key_iv: "726e49c4913196bb7dc613bc513b8b18"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.790086 30332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:15:48.790753 30351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:48.790900 30332 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:15:48.790983 30332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "a1504d00ee0e64b3e5cfaed3242ac958"
server_key_iv: "726e49c4913196bb7dc613bc513b8b18"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.791047 30332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:48.804702 30332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:48.806659 30332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:48.806792 30332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:48.807252 30332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:48.807299 30332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:48.807327 30332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:48.807348 30332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 16:15:48 dist-test-slave-nj21 krb5kdc[30146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292148, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:48.813630 30332 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:40577
I20260809 16:15:48.813727 30528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:40577 every 8 connection(s)
I20260809 16:15:48.813988 30332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:15:48.816327 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.807763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:56081 (local address 127.27.217.62:33599)
0809 16:15:48.807831 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:48.807834 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:48.808010 (+ 176us) server_negotiation.cc:407] Connection header received
0809 16:15:48.808433 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:48.808434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:48.808446 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:48.808521 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:48.809237 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.809995 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.811387 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.811714 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.811800 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.814073 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:48.814074 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:48.814075 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:48.814082 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:48.815286 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.815605 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.815606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.815606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.815652 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.815866 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.815867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.815867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.815970 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:48.816018 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:48.816195 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 16:15:48.816255 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 16:15:48.816470 30364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.807728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33599 (local address 127.27.217.1:56081)
0809 16:15:48.807887 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:48.807925 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:48.808346 (+ 421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:48.808584 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:48.808587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:48.808879 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:48.809140 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:48.809146 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.810084 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.810085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:48.811295 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:48.811298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.811816 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.811817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:48.811954 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.812411 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:48.812419 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:48.813978 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:48.815347 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:48.815351 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:48.815353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:48.815550 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:48.815722 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:48.815723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:48.815723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:48.815819 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:48.816014 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:48.816017 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:48.816112 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 16:15:48.816184 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 16:15:48.816291 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260809 16:15:48.816918 30529 heartbeater.cc:347] Connected to a master server at 127.27.217.62:33599
I20260809 16:15:48.816999 30529 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:48.817150 30529 heartbeater.cc:511] Master 127.27.217.62:33599 requested a full tablet report, sending...
I20260809 16:15:48.817677 30221 ts_manager.cc:194] Registered new tserver with Master: 102d93ba242c4e47a9ccbd58e9bbd6ac (127.27.217.1:40577)
I20260809 16:15:48.818549 30221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:56081
I20260809 16:15:48.819766 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30332
I20260809 16:15:48.819862 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:15:48.820024 28516 external_mini_cluster.cc:1428] Setting key 8b7a672ac4244e99cfe584f90e00e372
I20260809 16:15:48.823576 30539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.817887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33599 (local address 127.27.217.1:47241)
0809 16:15:48.818015 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:48.818025 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:48.818082 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:48.818181 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:48.818181 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:48.818364 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:48.818428 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:48.818429 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.819168 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.819169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:48.819822 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:48.819825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.820155 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.820155 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:48.820231 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.820561 (+ 330us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:48.820565 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:48.820876 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:48.822494 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:48.822495 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:48.822495 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:48.822762 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:48.822939 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:48.822940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:48.822940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:48.823000 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:48.823234 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:48.823234 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:48.823307 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 16:15:48.823367 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 16:15:48.823473 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260809 16:15:48.823585 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.817942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:47241 (local address 127.27.217.62:33599)
0809 16:15:48.817979 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:48.817980 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:48.818068 (+ 88us) server_negotiation.cc:407] Connection header received
0809 16:15:48.818130 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:48.818130 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:48.818137 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:48.818176 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:48.818489 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.819080 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.819894 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.820084 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.820135 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.820951 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:48.820953 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:48.820953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:48.820959 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:48.822397 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.822828 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.822829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.822830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.822887 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.823050 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.823051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.823051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.823171 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:48.823225 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:48.823413 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 16:15:48.823508 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:15:48.843994 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33599
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:48.922734 30544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:48.922989 30544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:48.923024 30544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:48.924188 30544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:48.924225 30544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:48.924252 30544 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:15:48.924273 30544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:15:48.925681 30544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:33599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:48.925908 30544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:48.926127 30544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:48.930959 30552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:48.931059 30553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:48.930979 30555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:48.931140 30544 server_base.cc:1034] running on GCE node
I20260809 16:15:48.931342 30544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:48.931557 30544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:48.932689 30544 hybrid_clock.cc:648] HybridClock initialized: now 1786292148932677 us; error 24 us; skew 500 ppm
Aug 09 16:15:48 dist-test-slave-nj21 krb5kdc[30146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292148, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:48.934960 30544 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:15:48.935360 30544 webserver.cc:460] Webserver started at http://127.27.217.2:42671/ using document root <none> and password file <none>
I20260809 16:15:48.935539 30544 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:48.935577 30544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:48.935693 30544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:48.936651 30544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "edb63e7a2b2e40138d0b426fca90ac5e"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "a4f923f728f7d9c66e1c8dc25f6690c3"
server_key_iv: "e450d727e13be2458278ba9608799118"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.936975 30544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "edb63e7a2b2e40138d0b426fca90ac5e"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "a4f923f728f7d9c66e1c8dc25f6690c3"
server_key_iv: "e450d727e13be2458278ba9608799118"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.938139 30544 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:48.938751 30564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:48.938894 30544 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:48.938969 30544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "edb63e7a2b2e40138d0b426fca90ac5e"
format_stamp: "Formatted at 2026-08-09 16:15:48 on dist-test-slave-nj21"
server_key: "a4f923f728f7d9c66e1c8dc25f6690c3"
server_key_iv: "e450d727e13be2458278ba9608799118"
server_key_version: "encryptionkey@0"
I20260809 16:15:48.939033 30544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:48.954748 30544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:48.956452 30544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:48.956568 30544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:48.957043 30544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:48.957082 30544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:48.957103 30544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:48.957113 30544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 16:15:48 dist-test-slave-nj21 krb5kdc[30146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292148, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:48.963783 30544 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:33091
I20260809 16:15:48.963996 30730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:33091 every 8 connection(s)
I20260809 16:15:48.964177 30544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:15:48.965766 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.957398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:36737 (local address 127.27.217.62:33599)
0809 16:15:48.957463 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:48.957465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:48.957622 (+ 157us) server_negotiation.cc:407] Connection header received
0809 16:15:48.958069 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:48.958070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:48.958082 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:48.958173 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:48.958757 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.959504 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.960502 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.960790 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.960865 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.963323 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:48.963325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:48.963325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:48.963333 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:48.964787 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.965111 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.965112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.965112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.965158 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.965314 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.965315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.965315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.965406 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:48.965450 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:48.965649 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 16:15:48.965705 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:15:48.965926 30575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.957355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33599 (local address 127.27.217.2:36737)
0809 16:15:48.957502 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:48.957539 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:48.957986 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:48.958247 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:48.958250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:48.958489 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:48.958686 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:48.958691 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.959597 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.959598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:48.960423 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:48.960426 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.960873 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.960873 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:48.960999 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.961439 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:48.961449 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:48.963235 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:48.964850 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:48.964853 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:48.964854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:48.965055 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:48.965196 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:48.965196 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:48.965197 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:48.965276 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:48.965455 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:48.965458 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:48.965558 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 16:15:48.965632 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 16:15:48.965741 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
I20260809 16:15:48.966379 30732 heartbeater.cc:347] Connected to a master server at 127.27.217.62:33599
I20260809 16:15:48.966454 30732 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:48.966601 30732 heartbeater.cc:511] Master 127.27.217.62:33599 requested a full tablet report, sending...
I20260809 16:15:48.966928 30222 ts_manager.cc:194] Registered new tserver with Master: edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091)
I20260809 16:15:48.967283 30222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:36737
I20260809 16:15:48.968355 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30544
I20260809 16:15:48.968441 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:15:48.968631 28516 external_mini_cluster.cc:1428] Setting key 8ed309dd02ddf3ec4436a7e8754cbae9
I20260809 16:15:48.972797 30740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.967296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33599 (local address 127.27.217.2:58791)
0809 16:15:48.967485 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:48.967495 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:48.967539 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:48.967649 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:48.967650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:48.967851 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:48.967911 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:48.967913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.968574 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.968575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:48.969266 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:48.969270 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.969586 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.969587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:48.969652 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.970007 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:48.970012 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:48.970320 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:48.971791 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:48.971792 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:48.971793 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:48.971999 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:48.972206 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:48.972206 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:48.972206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:48.972257 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:48.972553 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:48.972554 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:48.972587 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 16:15:48.972630 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:15:48.972702 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":81,"threads_started":1}
I20260809 16:15:48.972803 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:48.967366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:58791 (local address 127.27.217.62:33599)
0809 16:15:48.967397 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:48.967399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:48.967545 (+ 146us) server_negotiation.cc:407] Connection header received
0809 16:15:48.967571 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:48.967571 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:48.967580 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:48.967632 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:48.968014 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.968489 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.969342 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:48.969526 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:48.969573 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:48.970408 (+ 835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:48.970409 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:48.970409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:48.970415 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:48.971691 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.972089 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.972090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.972091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.972150 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:48.972311 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:48.972311 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:48.972312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:48.972499 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:48.972564 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:48.972658 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 16:15:48.972725 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:15:48.992290 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33599
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:49.071810 30746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:49.072070 30746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:49.072103 30746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:49.073449 30746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:49.073506 30746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:49.073531 30746 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:15:49.073552 30746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:15:49.075090 30746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:33599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:49.075273 30746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:49.075446 30746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:49.080015 30754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:49.080016 30758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:49.080142 30746 server_base.cc:1034] running on GCE node
W20260809 16:15:49.080225 30753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:49.080410 30746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:49.080629 30746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:49.081799 30746 hybrid_clock.cc:648] HybridClock initialized: now 1786292149081784 us; error 30 us; skew 500 ppm
Aug 09 16:15:49 dist-test-slave-nj21 krb5kdc[30146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292149, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:49.084300 30746 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:15:49.084774 30746 webserver.cc:460] Webserver started at http://127.27.217.3:42799/ using document root <none> and password file <none>
I20260809 16:15:49.084975 30746 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:49.085021 30746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:49.085160 30746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:49.086217 30746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "f29c4f3943dd4f43ab62394321c58abe"
format_stamp: "Formatted at 2026-08-09 16:15:49 on dist-test-slave-nj21"
server_key: "618120d6f1f3a7c7d1d57425ffa679b5"
server_key_iv: "9cbd72cf62a1b24886be75472e786c4e"
server_key_version: "encryptionkey@0"
I20260809 16:15:49.086566 30746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "f29c4f3943dd4f43ab62394321c58abe"
format_stamp: "Formatted at 2026-08-09 16:15:49 on dist-test-slave-nj21"
server_key: "618120d6f1f3a7c7d1d57425ffa679b5"
server_key_iv: "9cbd72cf62a1b24886be75472e786c4e"
server_key_version: "encryptionkey@0"
I20260809 16:15:49.087795 30746 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:15:49.088461 30768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:49.088605 30746 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:49.088686 30746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "f29c4f3943dd4f43ab62394321c58abe"
format_stamp: "Formatted at 2026-08-09 16:15:49 on dist-test-slave-nj21"
server_key: "618120d6f1f3a7c7d1d57425ffa679b5"
server_key_iv: "9cbd72cf62a1b24886be75472e786c4e"
server_key_version: "encryptionkey@0"
I20260809 16:15:49.088750 30746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:49.100884 30746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:49.102501 30746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:49.102628 30746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:49.103071 30746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:49.103114 30746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:49.103142 30746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:49.103159 30746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:49.109282 30746 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:33501
I20260809 16:15:49.109360 30950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:33501 every 8 connection(s)
Aug 09 16:15:49 dist-test-slave-nj21 krb5kdc[30146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292149, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:49.109632 30746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:15:49.112349 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.103502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:38175 (local address 127.27.217.62:33599)
0809 16:15:49.103564 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.103566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.103789 (+ 223us) server_negotiation.cc:407] Connection header received
0809 16:15:49.104243 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.104244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.104257 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.104323 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:49.105088 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.105878 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.107326 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.107619 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.107720 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.110094 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:49.110095 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:49.110096 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:49.110102 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:49.111222 (+ 1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.111572 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.111573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.111573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.111618 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.111834 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.111835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.111835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.111938 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:49.111989 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.112218 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.112286 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:15:49.112506 30782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.103463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33599 (local address 127.27.217.3:38175)
0809 16:15:49.103636 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.103701 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.104153 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.104407 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.104411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.104720 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:49.104986 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.104993 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.105970 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.105971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.107235 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.107239 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.107729 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.107730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.107868 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.108306 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:49.108316 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:49.110014 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:49.111294 (+ 1280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:49.111300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:49.111301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:49.111519 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:49.111660 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:49.111660 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:49.111661 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:49.111786 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:49.111984 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:49.111987 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:49.112104 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.112189 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.112306 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":75,"threads_started":1}
I20260809 16:15:49.113019 30952 heartbeater.cc:347] Connected to a master server at 127.27.217.62:33599
I20260809 16:15:49.113098 30952 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:49.113277 30952 heartbeater.cc:511] Master 127.27.217.62:33599 requested a full tablet report, sending...
I20260809 16:15:49.113677 30221 ts_manager.cc:194] Registered new tserver with Master: f29c4f3943dd4f43ab62394321c58abe (127.27.217.3:33501)
I20260809 16:15:49.114132 30221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:38175
I20260809 16:15:49.116971 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30746
I20260809 16:15:49.117092 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:15:49.117285 28516 external_mini_cluster.cc:1428] Setting key 4bab0afcdbd98dedfbff5e0fd58c539f
I20260809 16:15:49.118160 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:15:49.119900 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.114114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:42193 (local address 127.27.217.62:33599)
0809 16:15:49.114149 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.114151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.114259 (+ 108us) server_negotiation.cc:407] Connection header received
0809 16:15:49.114450 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.114450 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.114459 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.114519 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:49.114866 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.115332 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.116056 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.116257 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.116321 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.117242 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:49.117243 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:49.117243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:49.117249 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:49.118791 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.119119 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.119120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.119121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.119179 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.119355 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.119356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.119356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.119476 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:49.119545 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.119725 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.119805 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:15:49.119905 30961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.114063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33599 (local address 127.27.217.3:42193)
0809 16:15:49.114196 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.114206 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.114267 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.114538 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.114539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.114736 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:49.114791 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.114792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.115426 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.115427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.115984 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.115986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.116341 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.116342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.116416 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.116742 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:49.116746 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:49.117144 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:49.118873 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:49.118874 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:49.118875 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:49.119045 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:49.119235 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:49.119236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:49.119237 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:49.119300 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:49.119542 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:49.119543 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:49.119592 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.119661 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.119808 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
Aug 09 16:15:49 dist-test-slave-nj21 krb5kdc[30146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292149, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 16:15:49 dist-test-slave-nj21 krb5kdc[30146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292149, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:49.141156 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.134775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47262 (local address 127.27.217.62:33599)
0809 16:15:49.134826 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.134828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.134837 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:15:49.134901 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.134902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.134912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.134955 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:49.135504 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.136039 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.136722 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.136907 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.136958 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.138943 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:49.138945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:49.138945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:49.138952 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:49.140137 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.140468 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.140469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.140469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.140520 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.140677 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.140677 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.140678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.140785 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:49.140874 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.140995 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.141066 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:15:49.142697 30221 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:15:49.144341 30221 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:49.150564 30975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.146446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40577 (local address 127.0.0.1:44314)
0809 16:15:49.146950 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.146959 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.147008 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.147168 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.147171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.147173 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:49.147239 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.147241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.148234 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.148235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.149230 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.149233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.150248 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.150248 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.150324 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.150339 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.150403 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.150460 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":69,"threads_started":1}
I20260809 16:15:49.150563 30971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.146444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:33501 (local address 127.0.0.1:35482)
0809 16:15:49.146769 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.146814 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.146893 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.147250 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.147251 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.147254 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:49.147311 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.147312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.148718 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.148719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.149609 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.149611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.150338 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.150339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.150388 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.150391 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.150435 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.150463 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":56,"threads_started":1}
I20260809 16:15:49.150606 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.146580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35482 (local address 127.27.217.3:33501)
0809 16:15:49.146818 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.146823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.146873 (+ 50us) server_negotiation.cc:407] Connection header received
0809 16:15:49.147036 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.147038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.147056 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.147134 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:49.147398 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.148621 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.149685 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.150261 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.150334 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.150391 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.150464 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.150505 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":93,"threads_started":1}
I20260809 16:15:49.150873 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.146780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44314 (local address 127.27.217.1:40577)
0809 16:15:49.147010 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.147014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.147026 (+ 12us) server_negotiation.cc:407] Connection header received
0809 16:15:49.147066 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.147068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.147082 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.147154 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:49.147327 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.148141 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.149340 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.150099 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.150158 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.150218 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.150758 (+ 540us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.150795 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":95,"threads_started":1}
I20260809 16:15:49.151394 30849 tablet_service.cc:1467] Processing CreateTablet for tablet b6ade2f505b84c30b09aaacf73d4b75c (DEFAULT_TABLE table=test-table [id=3a787d1d81b8442c945810595cdbaf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:49.151412 30433 tablet_service.cc:1467] Processing CreateTablet for tablet b6ade2f505b84c30b09aaacf73d4b75c (DEFAULT_TABLE table=test-table [id=3a787d1d81b8442c945810595cdbaf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:49.151813 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ade2f505b84c30b09aaacf73d4b75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.151813 30849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ade2f505b84c30b09aaacf73d4b75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.154621 30979 tablet_bootstrap.cc:492] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: Bootstrap starting.
I20260809 16:15:49.155057 30973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.146646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:33091 (local address 127.0.0.1:50882)
0809 16:15:49.147233 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.147243 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.147289 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.147554 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.147555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.147557 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:49.147593 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.147594 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.148836 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.148837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.150082 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.150085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.154881 (+ 4796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.154882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.154931 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.154935 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.154975 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.155007 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":37,"threads_started":1}
I20260809 16:15:49.155139 30977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.146766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50882 (local address 127.27.217.2:33091)
0809 16:15:49.146941 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.146945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.147347 (+ 402us) server_negotiation.cc:407] Connection header received
0809 16:15:49.147394 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.147396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.147410 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.147489 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:49.147664 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.148757 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.150175 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.154799 (+ 4624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.154865 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.154928 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.154991 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.155038 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260809 16:15:49.155720 30979 tablet_bootstrap.cc:654] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.155838 30980 tablet_bootstrap.cc:492] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: Bootstrap starting.
I20260809 16:15:49.155721 30637 tablet_service.cc:1467] Processing CreateTablet for tablet b6ade2f505b84c30b09aaacf73d4b75c (DEFAULT_TABLE table=test-table [id=3a787d1d81b8442c945810595cdbaf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:49.156083 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ade2f505b84c30b09aaacf73d4b75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.156066 30979 log.cc:824] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:49.156455 30980 tablet_bootstrap.cc:654] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.156770 30980 log.cc:824] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:49.156906 30979 tablet_bootstrap.cc:492] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: No bootstrap required, opened a new log
I20260809 16:15:49.156978 30979 ts_tablet_manager.cc:1397] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 16:15:49.157544 30980 tablet_bootstrap.cc:492] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: No bootstrap required, opened a new log
I20260809 16:15:49.157621 30980 ts_tablet_manager.cc:1397] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:49.158946 30979 raft_consensus.cc:348] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.159053 30983 tablet_bootstrap.cc:492] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Bootstrap starting.
I20260809 16:15:49.159121 30979 raft_consensus.cc:374] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.159170 30979 raft_consensus.cc:729] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29c4f3943dd4f43ab62394321c58abe, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.159308 30979 consensus_queue.cc:260] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.159601 30979 ts_tablet_manager.cc:1428] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 16:15:49.159631 30983 tablet_bootstrap.cc:654] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.159746 30952 heartbeater.cc:503] Master 127.27.217.62:33599 was elected leader, sending a full tablet report...
I20260809 16:15:49.159749 30980 raft_consensus.cc:348] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.159895 30980 raft_consensus.cc:374] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.159943 30980 raft_consensus.cc:729] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102d93ba242c4e47a9ccbd58e9bbd6ac, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.159986 30983 log.cc:824] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:49.160071 30980 consensus_queue.cc:260] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.160327 30980 ts_tablet_manager.cc:1428] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:15:49.160363 30529 heartbeater.cc:503] Master 127.27.217.62:33599 was elected leader, sending a full tablet report...
I20260809 16:15:49.160669 30983 tablet_bootstrap.cc:492] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: No bootstrap required, opened a new log
I20260809 16:15:49.160733 30983 ts_tablet_manager.cc:1397] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:49.162174 30983 raft_consensus.cc:348] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.162320 30983 raft_consensus.cc:374] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.162354 30983 raft_consensus.cc:729] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb63e7a2b2e40138d0b426fca90ac5e, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.162456 30983 consensus_queue.cc:260] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.162668 30983 ts_tablet_manager.cc:1428] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:15:49.162721 30732 heartbeater.cc:503] Master 127.27.217.62:33599 was elected leader, sending a full tablet report...
W20260809 16:15:49.214757 30733 tablet.cc:2369] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:15:49.224749 30988 raft_consensus.cc:482] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:49.224876 30988 raft_consensus.cc:504] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.225225 30988 leader_election.cc:288] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 102d93ba242c4e47a9ccbd58e9bbd6ac (127.27.217.1:40577), edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091)
I20260809 16:15:49.228873 30977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.225485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:41801 (local address 127.27.217.2:33091)
0809 16:15:49.225535 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.225537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.225718 (+ 181us) server_negotiation.cc:407] Connection header received
0809 16:15:49.225761 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.225762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.225770 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.225868 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:49.225987 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.226675 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.227957 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.228517 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.228589 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.228597 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.228763 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.228808 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:15:49.228873 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.225471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:39043 (local address 127.27.217.1:40577)
0809 16:15:49.225517 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.225519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.225530 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:15:49.225593 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.225594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.225604 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.225664 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:49.225814 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.226570 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.227958 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.228517 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.228589 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.228597 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.228762 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.228800 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:15:49.228890 30782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.225405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40577 (local address 127.27.217.3:39043)
0809 16:15:49.225482 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.225494 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.225536 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.225670 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.225671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.225674 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:49.225749 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.225751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.226642 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.226643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.227865 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.227869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.228591 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.228592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.228701 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.228703 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.228751 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.228795 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":3}
I20260809 16:15:49.228899 30997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.225405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:33091 (local address 127.27.217.3:41801)
0809 16:15:49.225657 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.225665 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.225712 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.225877 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.225878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.225879 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:49.225931 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.225933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.226736 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.226737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.227865 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.227869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.228591 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.228592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.228687 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.228691 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.228751 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.228795 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":89,"thread_start_us":119,"threads_started":1}
I20260809 16:15:49.229261 30460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ade2f505b84c30b09aaacf73d4b75c" candidate_uuid: "f29c4f3943dd4f43ab62394321c58abe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" is_pre_election: true
I20260809 16:15:49.229421 30460 raft_consensus.cc:2454] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29c4f3943dd4f43ab62394321c58abe in term 0.
I20260809 16:15:49.229498 30666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ade2f505b84c30b09aaacf73d4b75c" candidate_uuid: "f29c4f3943dd4f43ab62394321c58abe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" is_pre_election: true
I20260809 16:15:49.229651 30666 raft_consensus.cc:2454] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29c4f3943dd4f43ab62394321c58abe in term 0.
I20260809 16:15:49.229650 30772 leader_election.cc:302] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102d93ba242c4e47a9ccbd58e9bbd6ac, f29c4f3943dd4f43ab62394321c58abe; no voters:
I20260809 16:15:49.229789 30988 raft_consensus.cc:2781] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:49.229859 30988 raft_consensus.cc:482] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:49.229883 30988 raft_consensus.cc:3037] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.230609 30988 raft_consensus.cc:504] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.230729 30988 leader_election.cc:288] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [CANDIDATE]: Term 1 election: Requested vote from peers 102d93ba242c4e47a9ccbd58e9bbd6ac (127.27.217.1:40577), edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091)
I20260809 16:15:49.230881 30666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ade2f505b84c30b09aaacf73d4b75c" candidate_uuid: "f29c4f3943dd4f43ab62394321c58abe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb63e7a2b2e40138d0b426fca90ac5e"
I20260809 16:15:49.230913 30460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6ade2f505b84c30b09aaacf73d4b75c" candidate_uuid: "f29c4f3943dd4f43ab62394321c58abe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac"
I20260809 16:15:49.230970 30666 raft_consensus.cc:3037] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.230981 30460 raft_consensus.cc:3037] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.231663 30666 raft_consensus.cc:2454] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29c4f3943dd4f43ab62394321c58abe in term 1.
I20260809 16:15:49.231760 30460 raft_consensus.cc:2454] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29c4f3943dd4f43ab62394321c58abe in term 1.
I20260809 16:15:49.232182 30774 leader_election.cc:302] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edb63e7a2b2e40138d0b426fca90ac5e, f29c4f3943dd4f43ab62394321c58abe; no voters:
I20260809 16:15:49.232281 30988 raft_consensus.cc:2781] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:49.232427 30988 raft_consensus.cc:686] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 1 LEADER]: Becoming Leader. State: Replica: f29c4f3943dd4f43ab62394321c58abe, State: Running, Role: LEADER
I20260809 16:15:49.232509 30988 consensus_queue.cc:237] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } }
I20260809 16:15:49.233289 30222 catalog_manager.cc:5495] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe reported cstate change: term changed from 0 to 1, leader changed from <none> to f29c4f3943dd4f43ab62394321c58abe (127.27.217.3). New cstate: current_term: 1 leader_uuid: "f29c4f3943dd4f43ab62394321c58abe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } health_report { overall_health: UNKNOWN } } }
I20260809 16:15:49.241091 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.239003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35484 (local address 127.27.217.3:33501)
0809 16:15:49.239042 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.239044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.239107 (+ 63us) server_negotiation.cc:407] Connection header received
0809 16:15:49.239172 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.239173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.239187 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.239236 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:49.239339 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.239816 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.240494 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.240665 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.240704 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.240849 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:49.240931 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:49.240977 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.241011 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.241026 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:15:49.242660 30666 raft_consensus.cc:1261] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Refusing update from remote peer f29c4f3943dd4f43ab62394321c58abe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:49.242667 30460 raft_consensus.cc:1261] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Refusing update from remote peer f29c4f3943dd4f43ab62394321c58abe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:49.242966 31001 consensus_queue.cc:1035] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:49.243081 30988 consensus_queue.cc:1035] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [LEADER]: Connected to new peer: Peer: permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:49.245260 31006 mvcc.cc:205] Tried to move back new op lower bound from 7316652643295870976 to 7316652643256987648. Current Snapshot: MvccSnapshot[applied={T|T < 7316652643295870976}]
I20260809 16:15:49.245620 31010 mvcc.cc:205] Tried to move back new op lower bound from 7316652643295870976 to 7316652643256987648. Current Snapshot: MvccSnapshot[applied={T|T < 7316652643295870976}]
I20260809 16:15:49.246030 31008 mvcc.cc:205] Tried to move back new op lower bound from 7316652643295870976 to 7316652643256987648. Current Snapshot: MvccSnapshot[applied={T|T < 7316652643295870976}]
I20260809 16:15:49.248598 30221 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:49.248674 30221 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:49.249420 30221 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f: Sending DeleteTablet for 3 replicas of tablet b6ade2f505b84c30b09aaacf73d4b75c
I20260809 16:15:49.249795 30849 tablet_service.cc:1514] Processing DeleteTablet for tablet b6ade2f505b84c30b09aaacf73d4b75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:49 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:35482
I20260809 16:15:49.249893 30637 tablet_service.cc:1514] Processing DeleteTablet for tablet b6ade2f505b84c30b09aaacf73d4b75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:49 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:50882
I20260809 16:15:49.250012 30433 tablet_service.cc:1514] Processing DeleteTablet for tablet b6ade2f505b84c30b09aaacf73d4b75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:49 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:44314
I20260809 16:15:49.250123 30221 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 16:15:49.250209 31022 tablet_replica.cc:330] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: stopping tablet replica
W20260809 16:15:49.250278 30221 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:49.250309 31022 raft_consensus.cc:2229] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:49.250674 31022 raft_consensus.cc:2258] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:49.251017 31021 tablet_replica.cc:330] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: stopping tablet replica
I20260809 16:15:49.251120 31021 raft_consensus.cc:2229] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:49.251245 31021 raft_consensus.cc:2258] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:49.250701 31020 tablet_replica.cc:330] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: stopping tablet replica
I20260809 16:15:49.251801 31022 ts_tablet_manager.cc:1905] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:49.251957 31021 ts_tablet_manager.cc:1905] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:49.252007 30849 tablet_service.cc:1467] Processing CreateTablet for tablet ba7dd790e2584b49aae9d45642977282 (DEFAULT_TABLE table=test-table [id=c822cbb48deb4ac5a39ba50b93bfb990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:49.252121 30849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7dd790e2584b49aae9d45642977282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.253444 31022 ts_tablet_manager.cc:1918] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:15:49.253458 30979 tablet_bootstrap.cc:492] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: Bootstrap starting.
I20260809 16:15:49.253516 31022 log.cc:1196] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/b6ade2f505b84c30b09aaacf73d4b75c
I20260809 16:15:49.253772 31022 ts_tablet_manager.cc:1939] T b6ade2f505b84c30b09aaacf73d4b75c P 102d93ba242c4e47a9ccbd58e9bbd6ac: Deleting consensus metadata
I20260809 16:15:49.253805 31021 ts_tablet_manager.cc:1918] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:15:49.253885 30979 tablet_bootstrap.cc:654] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.253990 31021 log.cc:1196] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/b6ade2f505b84c30b09aaacf73d4b75c
I20260809 16:15:49.254290 31021 ts_tablet_manager.cc:1939] T b6ade2f505b84c30b09aaacf73d4b75c P edb63e7a2b2e40138d0b426fca90ac5e: Deleting consensus metadata
I20260809 16:15:49.254364 30637 tablet_service.cc:1467] Processing CreateTablet for tablet ba7dd790e2584b49aae9d45642977282 (DEFAULT_TABLE table=test-table [id=c822cbb48deb4ac5a39ba50b93bfb990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:49.254487 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7dd790e2584b49aae9d45642977282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.255474 30983 tablet_bootstrap.cc:492] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: Bootstrap starting.
I20260809 16:15:49.255546 30199 catalog_manager.cc:4841] TS 102d93ba242c4e47a9ccbd58e9bbd6ac (127.27.217.1:40577): tablet b6ade2f505b84c30b09aaacf73d4b75c (table test-table [id=3a787d1d81b8442c945810595cdbaf0c]) successfully deleted
I20260809 16:15:49.255740 30201 catalog_manager.cc:4841] TS edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091): tablet b6ade2f505b84c30b09aaacf73d4b75c (table test-table [id=3a787d1d81b8442c945810595cdbaf0c]) successfully deleted
I20260809 16:15:49.255893 30983 tablet_bootstrap.cc:654] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.255950 31020 raft_consensus.cc:2229] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:15:49.256081 31020 raft_consensus.cc:2258] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:49.256263 30433 tablet_service.cc:1467] Processing CreateTablet for tablet ba7dd790e2584b49aae9d45642977282 (DEFAULT_TABLE table=test-table [id=c822cbb48deb4ac5a39ba50b93bfb990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:49.256364 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7dd790e2584b49aae9d45642977282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.256515 30979 tablet_bootstrap.cc:492] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: No bootstrap required, opened a new log
I20260809 16:15:49.256568 30979 ts_tablet_manager.cc:1397] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 16:15:49.256705 30979 raft_consensus.cc:348] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.256783 30979 raft_consensus.cc:374] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.256800 30979 raft_consensus.cc:729] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29c4f3943dd4f43ab62394321c58abe, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.256844 30979 consensus_queue.cc:260] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.256932 30979 ts_tablet_manager.cc:1428] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:49.257472 31020 ts_tablet_manager.cc:1905] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:49.257623 30980 tablet_bootstrap.cc:492] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Bootstrap starting.
I20260809 16:15:49.258019 30980 tablet_bootstrap.cc:654] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.258123 30983 tablet_bootstrap.cc:492] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: No bootstrap required, opened a new log
I20260809 16:15:49.258164 30983 ts_tablet_manager.cc:1397] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 16:15:49.258307 30983 raft_consensus.cc:348] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.258383 30983 raft_consensus.cc:374] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.258409 30983 raft_consensus.cc:729] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb63e7a2b2e40138d0b426fca90ac5e, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.258446 30983 consensus_queue.cc:260] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.258533 30983 ts_tablet_manager.cc:1428] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 16:15:49.259037 31020 ts_tablet_manager.cc:1918] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:15:49.259100 31020 log.cc:1196] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/b6ade2f505b84c30b09aaacf73d4b75c
I20260809 16:15:49.259290 31020 ts_tablet_manager.cc:1939] T b6ade2f505b84c30b09aaacf73d4b75c P f29c4f3943dd4f43ab62394321c58abe: Deleting consensus metadata
I20260809 16:15:49.259620 30201 catalog_manager.cc:4841] TS f29c4f3943dd4f43ab62394321c58abe (127.27.217.3:33501): tablet b6ade2f505b84c30b09aaacf73d4b75c (table test-table [id=3a787d1d81b8442c945810595cdbaf0c]) successfully deleted
I20260809 16:15:49.259930 30980 tablet_bootstrap.cc:492] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: No bootstrap required, opened a new log
I20260809 16:15:49.259974 30980 ts_tablet_manager.cc:1397] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:49.260109 30980 raft_consensus.cc:348] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.260160 30980 raft_consensus.cc:374] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.260172 30980 raft_consensus.cc:729] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102d93ba242c4e47a9ccbd58e9bbd6ac, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.260205 30980 consensus_queue.cc:260] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.260298 30980 ts_tablet_manager.cc:1428] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260809 16:15:49.314630 30530 tablet.cc:2369] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:15:49.360196 30953 tablet.cc:2369] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:15:49.486451 30992 raft_consensus.cc:482] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:49.486544 30992 raft_consensus.cc:504] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.486876 30992 leader_election.cc:288] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091), f29c4f3943dd4f43ab62394321c58abe (127.27.217.3:33501)
I20260809 16:15:49.488234 30988 raft_consensus.cc:482] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:49.488315 30988 raft_consensus.cc:504] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.488448 30988 leader_election.cc:288] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 102d93ba242c4e47a9ccbd58e9bbd6ac (127.27.217.1:40577), edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091)
I20260809 16:15:49.488600 30460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7dd790e2584b49aae9d45642977282" candidate_uuid: "f29c4f3943dd4f43ab62394321c58abe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" is_pre_election: true
I20260809 16:15:49.488683 30460 raft_consensus.cc:2454] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29c4f3943dd4f43ab62394321c58abe in term 0.
I20260809 16:15:49.488714 30666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7dd790e2584b49aae9d45642977282" candidate_uuid: "f29c4f3943dd4f43ab62394321c58abe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" is_pre_election: true
I20260809 16:15:49.488830 30666 raft_consensus.cc:2454] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29c4f3943dd4f43ab62394321c58abe in term 0.
I20260809 16:15:49.488838 30772 leader_election.cc:302] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102d93ba242c4e47a9ccbd58e9bbd6ac, f29c4f3943dd4f43ab62394321c58abe; no voters:
I20260809 16:15:49.488986 30988 raft_consensus.cc:2781] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:49.489027 30988 raft_consensus.cc:482] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:49.489045 30988 raft_consensus.cc:3037] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.489698 30988 raft_consensus.cc:504] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.489799 30988 leader_election.cc:288] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [CANDIDATE]: Term 1 election: Requested vote from peers 102d93ba242c4e47a9ccbd58e9bbd6ac (127.27.217.1:40577), edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091)
I20260809 16:15:49.490046 30460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7dd790e2584b49aae9d45642977282" candidate_uuid: "f29c4f3943dd4f43ab62394321c58abe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac"
I20260809 16:15:49.490051 30666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7dd790e2584b49aae9d45642977282" candidate_uuid: "f29c4f3943dd4f43ab62394321c58abe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb63e7a2b2e40138d0b426fca90ac5e"
I20260809 16:15:49.490121 30460 raft_consensus.cc:3037] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.490136 30666 raft_consensus.cc:3037] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.490847 30666 raft_consensus.cc:2454] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29c4f3943dd4f43ab62394321c58abe in term 1.
I20260809 16:15:49.490871 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.487272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:42565 (local address 127.27.217.3:33501)
0809 16:15:49.487327 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.487329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.487353 (+ 24us) server_negotiation.cc:407] Connection header received
0809 16:15:49.487417 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.487418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.487430 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.487478 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:49.487649 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.488429 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.489968 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.490542 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.490611 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.490621 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.490768 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.490810 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:15:49.490856 30460 raft_consensus.cc:2454] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29c4f3943dd4f43ab62394321c58abe in term 1.
I20260809 16:15:49.490949 31035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.487203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:33501 (local address 127.27.217.1:42565)
0809 16:15:49.487295 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.487304 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.487348 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.487505 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.487505 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.487507 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:49.487584 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.487586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.488521 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.488523 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.489888 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.489890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.490612 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.490613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.490689 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.490694 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.490756 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.490845 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":273,"thread_start_us":35,"threads_started":1}
I20260809 16:15:49.491083 30774 leader_election.cc:302] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edb63e7a2b2e40138d0b426fca90ac5e, f29c4f3943dd4f43ab62394321c58abe; no voters:
I20260809 16:15:49.491153 30988 raft_consensus.cc:2781] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:49.491155 30881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7dd790e2584b49aae9d45642977282" candidate_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29c4f3943dd4f43ab62394321c58abe" is_pre_election: true
I20260809 16:15:49.491251 30988 raft_consensus.cc:686] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 1 LEADER]: Becoming Leader. State: Replica: f29c4f3943dd4f43ab62394321c58abe, State: Running, Role: LEADER
I20260809 16:15:49.491317 30988 consensus_queue.cc:237] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.491649 30977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.487135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:44011 (local address 127.27.217.2:33091)
0809 16:15:49.487210 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.487212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.487251 (+ 39us) server_negotiation.cc:407] Connection header received
0809 16:15:49.487389 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.487390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.487400 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.487474 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:49.487657 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.488413 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.489906 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.491295 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.491362 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.491371 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.491532 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.491575 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 16:15:49.491845 30221 catalog_manager.cc:5495] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe reported cstate change: term changed from 0 to 1, leader changed from <none> to f29c4f3943dd4f43ab62394321c58abe (127.27.217.3). New cstate: current_term: 1 leader_uuid: "f29c4f3943dd4f43ab62394321c58abe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } health_report { overall_health: HEALTHY } } }
I20260809 16:15:49.491917 31028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.487037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:33091 (local address 127.27.217.1:44011)
0809 16:15:49.487174 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.487188 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.487261 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.487482 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.487483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.487487 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:49.487584 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.487589 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.488522 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.488523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.489803 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.489806 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.491363 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.491364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.491444 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.491449 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.491800 (+ 351us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.491844 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":25,"thread_start_us":62,"threads_started":1}
I20260809 16:15:49.492154 30666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7dd790e2584b49aae9d45642977282" candidate_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" is_pre_election: true
I20260809 16:15:49.492244 30666 raft_consensus.cc:2379] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 102d93ba242c4e47a9ccbd58e9bbd6ac in current term 1: Already voted for candidate f29c4f3943dd4f43ab62394321c58abe in this term.
I20260809 16:15:49.492429 30357 leader_election.cc:302] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 102d93ba242c4e47a9ccbd58e9bbd6ac; no voters: edb63e7a2b2e40138d0b426fca90ac5e, f29c4f3943dd4f43ab62394321c58abe
I20260809 16:15:49.492589 30992 raft_consensus.cc:2726] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Aug 09 16:15:49 dist-test-slave-nj21 krb5kdc[30146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292148, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:49.558422 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.552407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47270 (local address 127.27.217.62:33599)
0809 16:15:49.552468 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.552470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.552575 (+ 105us) server_negotiation.cc:407] Connection header received
0809 16:15:49.552631 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.552631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.552641 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.552688 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:49.553136 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.553611 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.554254 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.554429 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.554481 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.556388 (+ 1907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:49.556389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:49.556389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:49.556395 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:49.557410 (+ 1015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.557728 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.557729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.557729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.557776 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.557927 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.557928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.557929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.558025 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:49.558080 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.558211 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.558345 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":36}
I20260809 16:15:49.558435 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.552330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33599 (local address 127.0.0.1:47270)
0809 16:15:49.552509 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.552520 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.552583 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.552697 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.552698 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.553013 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:49.553058 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.553060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.553679 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.553680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.554184 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.554186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.554485 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.554486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.554534 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.554972 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:49.554976 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:49.556305 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:49.557476 (+ 1171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:49.557483 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:49.557485 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:49.557665 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:49.557826 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:49.557827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:49.557827 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:49.557876 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:49.558075 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:49.558083 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:49.558126 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.558184 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.558295 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
I20260809 16:15:49.560321 30221 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:47270:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 16:15:49.560527 30221 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:49.561844 30849 tablet_service.cc:1467] Processing CreateTablet for tablet f43f2630f5814d05b192c0f1648f7bc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b416eb7cd6c14be5be078e85cde65253]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:15:49.561849 30433 tablet_service.cc:1467] Processing CreateTablet for tablet f43f2630f5814d05b192c0f1648f7bc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b416eb7cd6c14be5be078e85cde65253]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:15:49.561849 30637 tablet_service.cc:1467] Processing CreateTablet for tablet f43f2630f5814d05b192c0f1648f7bc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b416eb7cd6c14be5be078e85cde65253]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:15:49.562005 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43f2630f5814d05b192c0f1648f7bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.562005 30433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43f2630f5814d05b192c0f1648f7bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.562005 30849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43f2630f5814d05b192c0f1648f7bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:49.563314 30979 tablet_bootstrap.cc:492] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: Bootstrap starting.
I20260809 16:15:49.563550 30980 tablet_bootstrap.cc:492] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Bootstrap starting.
I20260809 16:15:49.563551 30983 tablet_bootstrap.cc:492] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: Bootstrap starting.
I20260809 16:15:49.563727 30979 tablet_bootstrap.cc:654] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.563941 30983 tablet_bootstrap.cc:654] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.564013 30980 tablet_bootstrap.cc:654] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:49.564342 30979 tablet_bootstrap.cc:492] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: No bootstrap required, opened a new log
I20260809 16:15:49.564393 30979 ts_tablet_manager.cc:1397] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:15:49.564508 30983 tablet_bootstrap.cc:492] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: No bootstrap required, opened a new log
I20260809 16:15:49.564541 30983 ts_tablet_manager.cc:1397] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:15:49.564503 30979 raft_consensus.cc:348] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.564566 30979 raft_consensus.cc:374] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.564585 30979 raft_consensus.cc:729] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29c4f3943dd4f43ab62394321c58abe, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.564625 30979 consensus_queue.cc:260] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.564661 30983 raft_consensus.cc:348] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.564698 30979 ts_tablet_manager.cc:1428] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:49.564723 30983 raft_consensus.cc:374] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.564739 30983 raft_consensus.cc:729] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb63e7a2b2e40138d0b426fca90ac5e, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.564734 30988 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.564777 30983 consensus_queue.cc:260] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.564807 30988 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:49.564852 30983 ts_tablet_manager.cc:1428] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:49.564901 30993 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.564987 30993 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:49.565332 30980 tablet_bootstrap.cc:492] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: No bootstrap required, opened a new log
I20260809 16:15:49.565382 30980 ts_tablet_manager.cc:1397] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 16:15:49.565523 30980 raft_consensus.cc:348] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.565572 30980 raft_consensus.cc:374] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:49.565582 30980 raft_consensus.cc:729] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102d93ba242c4e47a9ccbd58e9bbd6ac, State: Initialized, Role: FOLLOWER
I20260809 16:15:49.565611 30980 consensus_queue.cc:260] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.565678 30980 ts_tablet_manager.cc:1428] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:49.565726 30992 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.565819 30992 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:49.869421 30992 raft_consensus.cc:482] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:49.869544 30992 raft_consensus.cc:504] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.869709 30992 leader_election.cc:288] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091), f29c4f3943dd4f43ab62394321c58abe (127.27.217.3:33501)
I20260809 16:15:49.869964 30666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43f2630f5814d05b192c0f1648f7bc0" candidate_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" is_pre_election: true
I20260809 16:15:49.869997 30881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43f2630f5814d05b192c0f1648f7bc0" candidate_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29c4f3943dd4f43ab62394321c58abe" is_pre_election: true
I20260809 16:15:49.870085 30666 raft_consensus.cc:2454] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 102d93ba242c4e47a9ccbd58e9bbd6ac in term 0.
I20260809 16:15:49.870098 30881 raft_consensus.cc:2454] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 102d93ba242c4e47a9ccbd58e9bbd6ac in term 0.
I20260809 16:15:49.870256 30357 leader_election.cc:302] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102d93ba242c4e47a9ccbd58e9bbd6ac, edb63e7a2b2e40138d0b426fca90ac5e; no voters:
I20260809 16:15:49.870354 30992 raft_consensus.cc:2781] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:49.870395 30992 raft_consensus.cc:482] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:49.870414 30992 raft_consensus.cc:3037] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.871116 30992 raft_consensus.cc:504] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.871243 30992 leader_election.cc:288] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [CANDIDATE]: Term 1 election: Requested vote from peers edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091), f29c4f3943dd4f43ab62394321c58abe (127.27.217.3:33501)
I20260809 16:15:49.871397 30666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43f2630f5814d05b192c0f1648f7bc0" candidate_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb63e7a2b2e40138d0b426fca90ac5e"
I20260809 16:15:49.871413 30881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43f2630f5814d05b192c0f1648f7bc0" candidate_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29c4f3943dd4f43ab62394321c58abe"
I20260809 16:15:49.871475 30666 raft_consensus.cc:3037] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.871479 30881 raft_consensus.cc:3037] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:49.872265 30666 raft_consensus.cc:2454] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 102d93ba242c4e47a9ccbd58e9bbd6ac in term 1.
I20260809 16:15:49.872355 30881 raft_consensus.cc:2454] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 102d93ba242c4e47a9ccbd58e9bbd6ac in term 1.
I20260809 16:15:49.872438 30357 leader_election.cc:302] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102d93ba242c4e47a9ccbd58e9bbd6ac, edb63e7a2b2e40138d0b426fca90ac5e; no voters:
I20260809 16:15:49.872548 30992 raft_consensus.cc:2781] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:49.872665 30992 raft_consensus.cc:686] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 LEADER]: Becoming Leader. State: Replica: 102d93ba242c4e47a9ccbd58e9bbd6ac, State: Running, Role: LEADER
I20260809 16:15:49.872725 30992 consensus_queue.cc:237] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } }
I20260809 16:15:49.873091 31054 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: TxnStatusTablet state changed. Reason: New leader 102d93ba242c4e47a9ccbd58e9bbd6ac. Latest consensus state: current_term: 1 leader_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.873175 31054 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:15:49.873375 31058 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 16:15:49.873502 31058 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 16:15:49.873438 30222 catalog_manager.cc:5495] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 102d93ba242c4e47a9ccbd58e9bbd6ac (127.27.217.1). New cstate: current_term: 1 leader_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } health_report { overall_health: UNKNOWN } } }
I20260809 16:15:49.912951 30988 consensus_queue.cc:1035] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:49.914556 31001 consensus_queue.cc:1035] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [LEADER]: Connected to new peer: Peer: permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:49.917742 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.914096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44316 (local address 127.27.217.1:40577)
0809 16:15:49.914846 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.914848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.914857 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:15:49.915285 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.915286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.915307 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.915589 (+ 282us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:49.915621 (+ 32us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.916183 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.916957 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.917172 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.917222 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.917391 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:49.917505 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:49.917566 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.917620 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.917643 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":81,"threads_started":1}
I20260809 16:15:49.917732 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.913959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40577 (local address 127.0.0.1:44316)
0809 16:15:49.914029 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.914042 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.914091 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.915470 (+ 1379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.915471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.915473 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:15:49.915529 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.915532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.916255 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.916257 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.916876 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.916879 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.917228 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.917229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.917297 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.917312 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:15:49.917558 (+ 246us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:15:49.917567 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.917606 (+ 39us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.917656 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 16:15:49.918761 30666 raft_consensus.cc:1261] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Refusing update from remote peer 102d93ba242c4e47a9ccbd58e9bbd6ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:49.918797 30881 raft_consensus.cc:1261] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe [term 1 FOLLOWER]: Refusing update from remote peer 102d93ba242c4e47a9ccbd58e9bbd6ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:49.918987 30992 consensus_queue.cc:1035] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:49.919094 31054 consensus_queue.cc:1035] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:49.919579 30993 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: TxnStatusTablet state changed. Reason: New leader 102d93ba242c4e47a9ccbd58e9bbd6ac. Latest consensus state: current_term: 1 leader_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.919664 30993 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:49.919708 30988 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: TxnStatusTablet state changed. Reason: New leader 102d93ba242c4e47a9ccbd58e9bbd6ac. Latest consensus state: current_term: 1 leader_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.919782 30988 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:49.920454 31054 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.920532 31054 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:15:49.920549 30993 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.920619 30993 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P edb63e7a2b2e40138d0b426fca90ac5e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:49.924613 30992 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.924692 30992 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P 102d93ba242c4e47a9ccbd58e9bbd6ac: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:15:49.925395 30988 tablet_replica.cc:439] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102d93ba242c4e47a9ccbd58e9bbd6ac" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40577 } } peers { permanent_uuid: "edb63e7a2b2e40138d0b426fca90ac5e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33091 } } peers { permanent_uuid: "f29c4f3943dd4f43ab62394321c58abe" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 33501 } } }
I20260809 16:15:49.925483 30988 tablet_replica.cc:442] T f43f2630f5814d05b192c0f1648f7bc0 P f29c4f3943dd4f43ab62394321c58abe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:49.927428 31086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.924696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40577 (local address 127.27.217.3:57763)
0809 16:15:49.924850 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.924862 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.924957 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.925060 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.925061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.925063 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:15:49.925130 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.925133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.925983 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.925983 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.926679 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.926682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.927112 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.927112 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.927157 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.927169 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:15:49.927302 (+ 133us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:15:49.927304 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.927329 (+ 25us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.927369 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":72,"threads_started":1}
I20260809 16:15:49.927417 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.924856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:57763 (local address 127.27.217.1:40577)
0809 16:15:49.924889 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.924890 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.924939 (+ 49us) server_negotiation.cc:407] Connection header received
0809 16:15:49.925009 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.925010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.925019 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.925056 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:49.925208 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.925851 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.926762 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.927044 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.927115 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.927227 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:49.927260 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:49.927303 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.927334 (+ 31us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.927353 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:15:49.936751 31091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.933901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:33501 (local address 127.27.217.1:36375)
0809 16:15:49.934070 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:49.934081 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:49.934133 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:49.934248 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:49.934248 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:49.934249 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:15:49.934283 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.934283 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.935116 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.935117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.935985 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:49.935988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.936433 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.936434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:49.936488 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.936500 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:15:49.936640 (+ 140us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:15:49.936641 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 16:15:49.936667 (+ 26us) client_negotiation.cc:240] Negotiation successful
0809 16:15:49.936699 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260809 16:15:49.936762 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.934024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:36375 (local address 127.27.217.3:33501)
0809 16:15:49.934065 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.934067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.934124 (+ 57us) server_negotiation.cc:407] Connection header received
0809 16:15:49.934171 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.934172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.934181 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.934247 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:49.934317 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.935047 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.936053 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.936350 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.936444 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.936558 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:49.936591 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:49.936631 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.936671 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.936693 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:15:49.945226 30222 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:49.945340 30222 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:49.945911 30222 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a602de5676454bf49d6fb3849cd4a37f: Sending DeleteTablet for 3 replicas of tablet ba7dd790e2584b49aae9d45642977282
I20260809 16:15:49.946137 30433 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7dd790e2584b49aae9d45642977282 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:49 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:44314
I20260809 16:15:49.946252 30637 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7dd790e2584b49aae9d45642977282 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:49 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:50882
I20260809 16:15:49.946404 31094 tablet_replica.cc:330] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: stopping tablet replica
I20260809 16:15:49.946435 31095 tablet_replica.cc:330] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: stopping tablet replica
I20260809 16:15:49.946432 30849 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7dd790e2584b49aae9d45642977282 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:49 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:35482
I20260809 16:15:49.946477 31094 raft_consensus.cc:2229] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:49.946483 31095 raft_consensus.cc:2229] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:49.946514 31094 raft_consensus.cc:2258] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:49.946519 31095 raft_consensus.cc:2258] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:49.946767 31095 ts_tablet_manager.cc:1905] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:49.946771 31094 ts_tablet_manager.cc:1905] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:49.947331 31097 tablet_replica.cc:330] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: stopping tablet replica
I20260809 16:15:49.947448 31097 raft_consensus.cc:2229] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:15:49.947549 31097 raft_consensus.cc:2258] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:49.947836 31097 ts_tablet_manager.cc:1905] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:49.948734 31095 ts_tablet_manager.cc:1918] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:49.948756 31094 ts_tablet_manager.cc:1918] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:49.948809 31094 log.cc:1196] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/ba7dd790e2584b49aae9d45642977282
I20260809 16:15:49.948872 31095 log.cc:1196] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/ba7dd790e2584b49aae9d45642977282
I20260809 16:15:49.949167 31094 ts_tablet_manager.cc:1939] T ba7dd790e2584b49aae9d45642977282 P 102d93ba242c4e47a9ccbd58e9bbd6ac: Deleting consensus metadata
I20260809 16:15:49.949216 31095 ts_tablet_manager.cc:1939] T ba7dd790e2584b49aae9d45642977282 P edb63e7a2b2e40138d0b426fca90ac5e: Deleting consensus metadata
I20260809 16:15:49.949427 31097 ts_tablet_manager.cc:1918] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:49.949553 30201 catalog_manager.cc:4841] TS edb63e7a2b2e40138d0b426fca90ac5e (127.27.217.2:33091): tablet ba7dd790e2584b49aae9d45642977282 (table test-table [id=c822cbb48deb4ac5a39ba50b93bfb990]) successfully deleted
I20260809 16:15:49.949554 30199 catalog_manager.cc:4841] TS 102d93ba242c4e47a9ccbd58e9bbd6ac (127.27.217.1:40577): tablet ba7dd790e2584b49aae9d45642977282 (table test-table [id=c822cbb48deb4ac5a39ba50b93bfb990]) successfully deleted
I20260809 16:15:49.949672 31097 log.cc:1196] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/ba7dd790e2584b49aae9d45642977282
I20260809 16:15:49.949911 31097 ts_tablet_manager.cc:1939] T ba7dd790e2584b49aae9d45642977282 P f29c4f3943dd4f43ab62394321c58abe: Deleting consensus metadata
I20260809 16:15:49.950158 30201 catalog_manager.cc:4841] TS f29c4f3943dd4f43ab62394321c58abe (127.27.217.3:33501): tablet ba7dd790e2584b49aae9d45642977282 (table test-table [id=c822cbb48deb4ac5a39ba50b93bfb990]) successfully deleted
Aug 09 16:15:49 dist-test-slave-nj21 krb5kdc[30146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292149, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:15:49.958971 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.951936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44324 (local address 127.27.217.1:40577)
0809 16:15:49.951975 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.951977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.952057 (+ 80us) server_negotiation.cc:407] Connection header received
0809 16:15:49.952126 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.952127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.952136 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.952182 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:49.952676 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.953132 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.953775 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.953961 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.954012 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.956386 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:49.956394 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:49.956395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:49.956401 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:49.957899 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.958196 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.958200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.958200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.958307 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.958478 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.958479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.958480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.958607 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:49.958748 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.958789 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.958865 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 16:15:49.959239 30520 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44324
I20260809 16:15:49.967742 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:49.960171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47274 (local address 127.27.217.62:33599)
0809 16:15:49.960219 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:49.960220 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:49.960229 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:15:49.960254 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:49.960255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:49.960265 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:49.960309 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:49.960750 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.961226 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.961876 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:49.962080 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:49.962131 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:49.963643 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:49.963644 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:49.963645 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:49.963652 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:49.965192 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.967059 (+ 1867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.967060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.967061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.967118 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:49.967272 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:49.967273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:49.967273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:49.967380 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:49.967483 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:49.967560 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 16:15:49.967632 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260809 16:15:49.967971 30222 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47274
I20260809 16:15:49.968439 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30332
I20260809 16:15:49.982663 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30544
I20260809 16:15:49.990873 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30746
I20260809 16:15:49.999297 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30167
2026-08-09T16:15:50Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2732 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:15:50 dist-test-slave-nj21 krb5kdc[31107](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:15:50 dist-test-slave-nj21 krb5kdc[31107](info): set up 2 sockets
Aug 09 16:15:50 dist-test-slave-nj21 krb5kdc[31107](info): commencing operation
krb5kdc: starting...
W20260809 16:15:51.149289 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:15:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:15:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:15:51.262759 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45659
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:45659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:51.341996 31126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:51.342192 31126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:51.342213 31126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:51.343328 31126 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:15:51.343367 31126 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 16:15:51.343379 31126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:51.343391 31126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:51.343402 31126 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:15:51.343412 31126 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:15:51.344863 31126 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:45659
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:51.345100 31126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:51.345305 31126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:51.349938 31139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:51.349982 31135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:51.349990 31137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:51.350111 31126 server_base.cc:1034] running on GCE node
I20260809 16:15:51.350348 31126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:51.350656 31126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:51.351801 31126 hybrid_clock.cc:648] HybridClock initialized: now 1786292151351780 us; error 30 us; skew 500 ppm
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:51.354135 31126 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:15:51.354573 31126 webserver.cc:460] Webserver started at http://127.27.217.62:41735/ using document root <none> and password file <none>
I20260809 16:15:51.354770 31126 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:51.354817 31126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:51.354950 31126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:51.356025 31126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "3be6758fda3443cc8eaa696e7166687a"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "c584e5864ff790724a3d88de44f6d30b"
server_key_iv: "faf54bb181a859d718dcecc844348d6c"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.356348 31126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "3be6758fda3443cc8eaa696e7166687a"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "c584e5864ff790724a3d88de44f6d30b"
server_key_iv: "faf54bb181a859d718dcecc844348d6c"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.357579 31126 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:51.358227 31149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:51.358376 31126 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:51.358471 31126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "3be6758fda3443cc8eaa696e7166687a"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "c584e5864ff790724a3d88de44f6d30b"
server_key_iv: "faf54bb181a859d718dcecc844348d6c"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.358533 31126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:51.378577 31126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:51.380702 31126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:51.380844 31126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:51.385277 31126 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:45659
I20260809 16:15:51.385341 31247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:45659 every 8 connection(s)
I20260809 16:15:51.385640 31126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:15:51.386247 31252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:51.387301 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31126
I20260809 16:15:51.387391 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:15:51.387557 28516 external_mini_cluster.cc:1428] Setting key efaecfac65ddba586017a2f46edcf921
I20260809 16:15:51.388948 31252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: Bootstrap starting.
I20260809 16:15:51.389724 31252 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:51.389997 31252 log.cc:824] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:51.390661 31252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: No bootstrap required, opened a new log
I20260809 16:15:51.392869 31252 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be6758fda3443cc8eaa696e7166687a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45659 } }
I20260809 16:15:51.393059 31252 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:51.393103 31252 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be6758fda3443cc8eaa696e7166687a, State: Initialized, Role: FOLLOWER
I20260809 16:15:51.393235 31252 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be6758fda3443cc8eaa696e7166687a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45659 } }
I20260809 16:15:51.393316 31252 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:15:51.393355 31252 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:15:51.393405 31252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:51.393985 31252 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be6758fda3443cc8eaa696e7166687a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45659 } }
I20260809 16:15:51.394073 31252 leader_election.cc:302] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3be6758fda3443cc8eaa696e7166687a; no voters:
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:51.394220 31252 leader_election.cc:288] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:15:51.394276 31258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:51.394452 31252 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:15:51.394480 31258 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [term 1 LEADER]: Becoming Leader. State: Replica: 3be6758fda3443cc8eaa696e7166687a, State: Running, Role: LEADER
I20260809 16:15:51.394696 31258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be6758fda3443cc8eaa696e7166687a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45659 } }
I20260809 16:15:51.395311 31263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3be6758fda3443cc8eaa696e7166687a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be6758fda3443cc8eaa696e7166687a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45659 } } }
I20260809 16:15:51.395393 31263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:51.395536 31263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3be6758fda3443cc8eaa696e7166687a. Latest consensus state: current_term: 1 leader_uuid: "3be6758fda3443cc8eaa696e7166687a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be6758fda3443cc8eaa696e7166687a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45659 } } }
W20260809 16:15:51.396360 31287 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 16:15:51.396723 31263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a [sys.catalog]: This master's current role is: LEADER
W20260809 16:15:51.396729 31287 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:15:51.396889 31278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:15:51.397078 31278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:15:51.398190 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.388076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48752 (local address 127.27.217.62:45659)
0809 16:15:51.388230 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.388239 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.388265 (+ 26us) server_negotiation.cc:407] Connection header received
0809 16:15:51.388715 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.388722 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.388769 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.388884 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:51.389638 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.390697 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.391749 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.392159 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.392239 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.394775 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:51.394779 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:51.394779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:51.394790 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:51.396727 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.397096 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.397099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.397100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.397206 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.397383 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.397383 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.397384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.397613 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:51.397751 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.397858 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.398000 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
I20260809 16:15:51.398547 31278 catalog_manager.cc:1347] Generated new cluster ID: 5d23a300bf56440a95b0d0d887c4ccae
I20260809 16:15:51.398602 31278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:15:51.408038 31278 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:15:51.408562 31278 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:15:51.416332 31278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: Generated new TSK 0
I20260809 16:15:51.416498 31278 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:15:51.442163 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45659
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:51.522009 31295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:51.522203 31295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:51.522226 31295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:51.523350 31295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:51.523389 31295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:51.523411 31295 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 16:15:51.523433 31295 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:15:51.523463 31295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:15:51.524979 31295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:45659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:51.525204 31295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:51.525425 31295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:51.530089 31304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:51.530097 31305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:51.530246 31295 server_base.cc:1034] running on GCE node
W20260809 16:15:51.530119 31307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:51.530475 31295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:51.530700 31295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:51.531837 31295 hybrid_clock.cc:648] HybridClock initialized: now 1786292151531820 us; error 27 us; skew 500 ppm
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:51.534148 31295 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:15:51.534578 31295 webserver.cc:460] Webserver started at http://127.27.217.1:41193/ using document root <none> and password file <none>
I20260809 16:15:51.534811 31295 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:51.534859 31295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:51.534986 31295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:51.536027 31295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "f329136214454bb9bf49070ffbd1201a"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "d8f9e223f375c6329fb7e73f75c52d57"
server_key_iv: "3412af3ca2830a6d93e884e09bafd00c"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.536356 31295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "f329136214454bb9bf49070ffbd1201a"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "d8f9e223f375c6329fb7e73f75c52d57"
server_key_iv: "3412af3ca2830a6d93e884e09bafd00c"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.537556 31295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:51.538220 31316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:51.538364 31295 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:51.538448 31295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "f329136214454bb9bf49070ffbd1201a"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "d8f9e223f375c6329fb7e73f75c52d57"
server_key_iv: "3412af3ca2830a6d93e884e09bafd00c"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.538511 31295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:51.547711 31295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:51.549281 31295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:51.549407 31295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:51.549898 31295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:51.549938 31295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:51.549973 31295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:51.550034 31295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:51.556933 31295 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:43147
I20260809 16:15:51.556994 31487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:43147 every 8 connection(s)
I20260809 16:15:51.557317 31295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:15:51.559044 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.550263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:37033 (local address 127.27.217.62:45659)
0809 16:15:51.550311 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.550313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.550538 (+ 225us) server_negotiation.cc:407] Connection header received
0809 16:15:51.550964 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.550966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.550980 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.551051 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:51.551599 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.552387 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.553403 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.553627 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.553684 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.556614 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:51.556616 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:51.556616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:51.556623 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:51.558022 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.558356 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.558357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.558357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.558406 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.558582 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.558582 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.558583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.558675 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:51.558720 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.558913 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.558979 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:15:51.559190 31329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.550263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45659 (local address 127.27.217.1:37033)
0809 16:15:51.550414 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.550449 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.550876 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.551101 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.551104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.551316 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:51.551519 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.551525 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.552493 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.552494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.553316 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.553319 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.553699 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.553700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.553823 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.554302 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:51.554313 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:51.556535 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:51.558088 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.558092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.558093 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.558293 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.558455 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.558456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.558456 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.558540 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.558716 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:51.558718 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:51.558820 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.558893 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.559006 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260809 16:15:51.559696 31489 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45659
I20260809 16:15:51.559783 31489 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:51.559948 31489 heartbeater.cc:511] Master 127.27.217.62:45659 requested a full tablet report, sending...
I20260809 16:15:51.560475 31174 ts_manager.cc:194] Registered new tserver with Master: f329136214454bb9bf49070ffbd1201a (127.27.217.1:43147)
I20260809 16:15:51.561367 31174 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:37033
I20260809 16:15:51.565379 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.560749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:42979 (local address 127.27.217.62:45659)
0809 16:15:51.560789 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.560791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.560896 (+ 105us) server_negotiation.cc:407] Connection header received
0809 16:15:51.560937 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.560937 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.560946 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.560993 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:51.561307 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.561855 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.562568 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.562741 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.562795 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.563525 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:51.563526 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:51.563526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:51.563530 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:51.564644 (+ 1114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.564920 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.564921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.564921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.564966 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.565078 (+ 112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.565078 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.565078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.565158 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:51.565197 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.565276 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.565326 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 16:15:51.565383 31497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.560706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45659 (local address 127.27.217.1:42979)
0809 16:15:51.560832 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.560841 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.560893 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.560997 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.560997 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.561178 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:51.561251 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.561253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.561942 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.561943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.562511 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.562513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.562796 (+ 283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.562796 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.562850 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.563202 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:51.563207 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:51.563462 (+ 255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:51.564721 (+ 1259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.564722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.564722 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.564869 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.565005 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.565005 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.565006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.565045 (+ 39us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.565190 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:51.565190 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:51.565220 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.565261 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.565324 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
I20260809 16:15:51.566797 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31295
I20260809 16:15:51.566874 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:15:51.567032 28516 external_mini_cluster.cc:1428] Setting key f2d3c809d95fec18b59dcd155fef077d
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:15:51.590559 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45659
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:51.669857 31501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:51.670060 31501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:51.670083 31501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:51.671139 31501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:51.671172 31501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:51.671191 31501 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 16:15:51.671205 31501 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:15:51.671221 31501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:15:51.672624 31501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:45659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:51.672811 31501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:51.672991 31501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:51.678156 31511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:51.678303 31510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:51.678242 31513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:51.678481 31501 server_base.cc:1034] running on GCE node
I20260809 16:15:51.678670 31501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:51.678912 31501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:51.680089 31501 hybrid_clock.cc:648] HybridClock initialized: now 1786292151680069 us; error 35 us; skew 500 ppm
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:51.682909 31501 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:15:51.683364 31501 webserver.cc:460] Webserver started at http://127.27.217.2:46251/ using document root <none> and password file <none>
I20260809 16:15:51.683545 31501 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:51.683583 31501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:51.683692 31501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:51.684670 31501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "5ce8857dafc644e5aff4a514e7da61e5"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "33e2ebe1519614fbc711675bf3de4b09"
server_key_iv: "c78dad71ad546f8a3f5a850c1d90be27"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.684988 31501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "5ce8857dafc644e5aff4a514e7da61e5"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "33e2ebe1519614fbc711675bf3de4b09"
server_key_iv: "c78dad71ad546f8a3f5a850c1d90be27"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.686110 31501 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:15:51.686713 31526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:51.686852 31501 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:51.686936 31501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "5ce8857dafc644e5aff4a514e7da61e5"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "33e2ebe1519614fbc711675bf3de4b09"
server_key_iv: "c78dad71ad546f8a3f5a850c1d90be27"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.687001 31501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:51.698004 31501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:51.699611 31501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:51.699772 31501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:51.700280 31501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:51.700322 31501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:51.700350 31501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:51.700390 31501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:51.707536 31501 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:41355
I20260809 16:15:51.707724 31694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:41355 every 8 connection(s)
I20260809 16:15:51.707957 31501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:15:51.709697 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.700622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:38951 (local address 127.27.217.62:45659)
0809 16:15:51.700673 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.700675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.700954 (+ 279us) server_negotiation.cc:407] Connection header received
0809 16:15:51.701593 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.701594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.701603 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.701643 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:51.702465 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.702988 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.704440 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.704717 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.704776 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.707163 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:51.707164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:51.707164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:51.707171 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:51.708663 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.709004 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.709005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.709005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.709058 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.709230 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.709231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.709231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.709321 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:51.709362 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.709577 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.709634 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:15:51.709853 31536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.700618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45659 (local address 127.27.217.2:38951)
0809 16:15:51.700798 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.700846 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.701483 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.701717 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.701722 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.702084 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:51.702366 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.702372 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.703058 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.703059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.704358 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.704362 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.704821 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.704822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.704963 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.705421 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:51.705430 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:51.707078 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:51.708726 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.708728 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.708730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.708944 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.709101 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.709101 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.709101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.709195 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.709359 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:51.709362 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:51.709478 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.709553 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.709666 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260809 16:15:51.710323 31696 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45659
I20260809 16:15:51.710404 31696 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:51.710582 31696 heartbeater.cc:511] Master 127.27.217.62:45659 requested a full tablet report, sending...
I20260809 16:15:51.710952 31172 ts_manager.cc:194] Registered new tserver with Master: 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355)
I20260809 16:15:51.711329 31172 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:38951
I20260809 16:15:51.715204 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31501
I20260809 16:15:51.715301 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:15:51.715500 28516 external_mini_cluster.cc:1428] Setting key 19c8c1cb7bbc3ed1ed3b4d71d9f46123
I20260809 16:15:51.715984 31703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.711276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45659 (local address 127.27.217.2:58169)
0809 16:15:51.711395 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.711404 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.711488 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.711604 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.711605 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.711821 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:51.711886 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.711888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.712479 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.712480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.712957 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.712959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.713214 (+ 255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.713215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.713267 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.713619 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:51.713624 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:51.713875 (+ 251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:51.714960 (+ 1085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.714961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.714961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.715108 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.715300 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.715301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.715302 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.715365 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.715724 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:51.715725 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:51.715770 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.715832 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.715906 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":72,"threads_started":1}
I20260809 16:15:51.716015 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.711343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:58169 (local address 127.27.217.62:45659)
0809 16:15:51.711383 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.711384 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.711463 (+ 79us) server_negotiation.cc:407] Connection header received
0809 16:15:51.711536 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.711537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.711546 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.711600 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:51.711956 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.712382 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.713008 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.713170 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.713211 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.713934 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:51.713934 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:51.713935 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:51.713939 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:51.714899 (+ 960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.715169 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.715170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.715171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.715227 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.715415 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.715415 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.715416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.715618 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:51.715729 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.715855 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.715926 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:15:51.740012 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45659
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:33415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:51.819612 31708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:51.819813 31708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:51.819836 31708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:51.820901 31708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:51.820937 31708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:51.820955 31708 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 16:15:51.820969 31708 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:15:51.820984 31708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:15:51.822338 31708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:45659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:51.822520 31708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:51.822697 31708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:51.827382 31716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:51.827389 31720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:51.827466 31717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:51.827564 31708 server_base.cc:1034] running on GCE node
I20260809 16:15:51.827899 31708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:51.828123 31708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:51.829262 31708 hybrid_clock.cc:648] HybridClock initialized: now 1786292151829247 us; error 25 us; skew 500 ppm
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:51.831770 31708 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:15:51.832259 31708 webserver.cc:460] Webserver started at http://127.27.217.3:36253/ using document root <none> and password file <none>
I20260809 16:15:51.832526 31708 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:51.832592 31708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:51.832717 31708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:51.834062 31708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "ceba6675c2a940a2934fec4d75c7c9b2"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "6c0b1d9d653aa9414ff0f9f39eb9c9d8"
server_key_iv: "cd0114ed225f20b228b2c3b8f4fd8169"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.834362 31708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "ceba6675c2a940a2934fec4d75c7c9b2"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "6c0b1d9d653aa9414ff0f9f39eb9c9d8"
server_key_iv: "cd0114ed225f20b228b2c3b8f4fd8169"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.835608 31708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:15:51.836333 31728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:51.836504 31708 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:51.836583 31708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "ceba6675c2a940a2934fec4d75c7c9b2"
format_stamp: "Formatted at 2026-08-09 16:15:51 on dist-test-slave-nj21"
server_key: "6c0b1d9d653aa9414ff0f9f39eb9c9d8"
server_key_iv: "cd0114ed225f20b228b2c3b8f4fd8169"
server_key_version: "encryptionkey@0"
I20260809 16:15:51.836648 31708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:51.854549 31708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:51.856172 31708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:51.856293 31708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:51.856750 31708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:51.856789 31708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:51.856809 31708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:51.856822 31708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:51.863133 31708 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:38587
I20260809 16:15:51.863219 31917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:38587 every 8 connection(s)
I20260809 16:15:51.863471 31708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:15:51.864776 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31708
I20260809 16:15:51.864873 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:15:51.865068 28516 external_mini_cluster.cc:1428] Setting key 462137b74f10836b65dad3d9b493e3f2
I20260809 16:15:51.866160 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.857185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:53621 (local address 127.27.217.62:45659)
0809 16:15:51.857251 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.857253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.857399 (+ 146us) server_negotiation.cc:407] Connection header received
0809 16:15:51.857837 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.857838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.857851 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.857927 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:51.858617 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.859343 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.860814 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.861108 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.861186 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.863605 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:51.863606 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:51.863606 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:51.863613 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:51.864744 (+ 1131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.865198 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.865199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.865199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.865267 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.865546 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.865546 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.865547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.865693 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:51.865748 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.866032 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.866097 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:15:51.866302 31741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.857123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45659 (local address 127.27.217.3:53621)
0809 16:15:51.857281 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.857318 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.857756 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.857978 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.857981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.858246 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:51.858523 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.858529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.859441 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.859442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.860723 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.860727 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.861204 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.861205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.861361 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.861904 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:51.861913 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:51.863506 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:51.864817 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.864824 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.864827 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.865120 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.865338 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.865339 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.865339 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.865484 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.865755 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:51.865760 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:51.865903 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.866004 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.866121 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260809 16:15:51.866724 31918 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45659
I20260809 16:15:51.866802 31918 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:51.866958 31918 heartbeater.cc:511] Master 127.27.217.62:45659 requested a full tablet report, sending...
I20260809 16:15:51.867261 31172 ts_manager.cc:194] Registered new tserver with Master: ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587)
I20260809 16:15:51.867596 31172 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:53621
I20260809 16:15:51.872025 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.867703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:33055 (local address 127.27.217.62:45659)
0809 16:15:51.867735 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.867736 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.867813 (+ 77us) server_negotiation.cc:407] Connection header received
0809 16:15:51.867871 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.867872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.867881 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.867926 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:51.868240 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.868666 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.869255 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.869415 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.869471 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.870118 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:51.870120 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:51.870120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:51.870125 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:51.871248 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.871487 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.871488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.871488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.871526 (+ 38us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.871629 (+ 103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.871629 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.871630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.871739 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:51.871785 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.871914 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.871970 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 16:15:51.872036 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.867616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45659 (local address 127.27.217.3:33055)
0809 16:15:51.867759 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.867769 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.867823 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.867929 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.867930 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.868121 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:51.868172 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.868174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.868739 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.868740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.869201 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.869202 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.869475 (+ 273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.869475 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.869527 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.869814 (+ 287us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:51.869817 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:51.870056 (+ 239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:51.871303 (+ 1247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.871304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.871304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.871445 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.871559 (+ 114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:51.871560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:51.871560 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:51.871600 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:51.871780 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:51.871780 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:51.871823 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.871889 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.871978 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":96,"threads_started":1}
I20260809 16:15:51.876554 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 16:15:51 dist-test-slave-nj21 krb5kdc[31107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:51.898828 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.892107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48768 (local address 127.27.217.62:45659)
0809 16:15:51.892158 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.892160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.892168 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:15:51.892220 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.892221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.892233 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.892277 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:51.892805 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.893284 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.893963 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.894168 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.894224 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.896812 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:51.896813 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:51.896813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:51.896821 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:51.897825 (+ 1004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.898142 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.898143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.898144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.898195 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:51.898357 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:51.898358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:51.898358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:51.898466 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:51.898551 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.898665 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.898739 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:15:51.900357 31172 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:15:51.901914 31172 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:51.907830 31940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.903923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:43147 (local address 127.0.0.1:50498)
0809 16:15:51.904073 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.904113 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.904177 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.904564 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.904568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.904570 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:51.904635 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.904637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.905585 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.905586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.906752 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.906754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.907521 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.907522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.907600 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.907613 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.907697 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.907751 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":9,"thread_start_us":54,"threads_started":1}
I20260809 16:15:51.907994 31943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.904048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.27.217.1:43147)
0809 16:15:51.904389 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.904394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.904404 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:15:51.904453 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.904455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.904471 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.904542 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:51.904715 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.905516 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.906832 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.907447 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.907508 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.907565 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.907766 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.907806 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":75,"threads_started":1}
I20260809 16:15:51.908116 31945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.903951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:38587 (local address 127.0.0.1:46498)
0809 16:15:51.904214 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.904225 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.904276 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.904623 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.904624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.904626 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:51.904682 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.904684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.905958 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.905959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.906985 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.906987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.907900 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.907901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.907974 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.907978 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.908008 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.908048 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":11,"thread_start_us":49,"threads_started":1}
I20260809 16:15:51.908214 31941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.904125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:41355 (local address 127.0.0.1:49178)
0809 16:15:51.904421 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:51.904430 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:51.904482 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:51.904920 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:51.904921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:51.904923 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:51.904967 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.904969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.906122 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.906123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.907054 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:51.907057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.908021 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.908022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:51.908079 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.908083 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:15:51.908125 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 16:15:51.908160 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":32,"threads_started":1}
I20260809 16:15:51.908427 31946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.904236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49178 (local address 127.27.217.2:41355)
0809 16:15:51.904407 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.904412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.904475 (+ 63us) server_negotiation.cc:407] Connection header received
0809 16:15:51.904817 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.904821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.904837 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.904909 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:51.905038 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.906054 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.907123 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.907876 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.907931 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.907990 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.908298 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.908340 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260809 16:15:51.908496 31947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:51.904232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46498 (local address 127.27.217.3:38587)
0809 16:15:51.904450 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:51.904453 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:51.904462 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:15:51.904501 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:51.904503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:51.904518 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:51.904620 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:51.904766 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.905873 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.907056 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:51.907799 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:51.908280 (+ 481us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:51.908345 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:51.908367 (+ 22us) server_negotiation.cc:299] Negotiation successful
0809 16:15:51.908407 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":103,"threads_started":1}
I20260809 16:15:51.908600 31388 tablet_service.cc:1467] Processing CreateTablet for tablet e4de9bf74da345b19d4d6ad0f9989964 (DEFAULT_TABLE table=test-table [id=044da236914a429190a6056eed00ed5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:51.908998 31388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4de9bf74da345b19d4d6ad0f9989964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:51.912149 31948 tablet_bootstrap.cc:492] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Bootstrap starting.
I20260809 16:15:51.912585 31802 tablet_service.cc:1467] Processing CreateTablet for tablet e4de9bf74da345b19d4d6ad0f9989964 (DEFAULT_TABLE table=test-table [id=044da236914a429190a6056eed00ed5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:51.912691 31948 tablet_bootstrap.cc:654] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:51.912863 31802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4de9bf74da345b19d4d6ad0f9989964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:51.912968 31948 log.cc:824] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:51.913619 31948 tablet_bootstrap.cc:492] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: No bootstrap required, opened a new log
I20260809 16:15:51.913681 31948 ts_tablet_manager.cc:1397] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:51.915014 31948 raft_consensus.cc:348] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:51.915158 31948 raft_consensus.cc:374] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:51.915203 31948 raft_consensus.cc:729] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Initialized, Role: FOLLOWER
I20260809 16:15:51.915308 31948 consensus_queue.cc:260] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:51.915573 31948 ts_tablet_manager.cc:1428] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:15:51.915584 31489 heartbeater.cc:503] Master 127.27.217.62:45659 was elected leader, sending a full tablet report...
I20260809 16:15:51.915594 31950 tablet_bootstrap.cc:492] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Bootstrap starting.
I20260809 16:15:51.916568 31950 tablet_bootstrap.cc:654] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:51.916469 31592 tablet_service.cc:1467] Processing CreateTablet for tablet e4de9bf74da345b19d4d6ad0f9989964 (DEFAULT_TABLE table=test-table [id=044da236914a429190a6056eed00ed5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:51.916788 31592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4de9bf74da345b19d4d6ad0f9989964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:51.916893 31950 log.cc:824] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:51.917586 31950 tablet_bootstrap.cc:492] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: No bootstrap required, opened a new log
I20260809 16:15:51.917660 31950 ts_tablet_manager.cc:1397] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:15:51.919586 31950 raft_consensus.cc:348] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:51.919808 31950 raft_consensus.cc:374] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:51.919859 31950 raft_consensus.cc:729] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceba6675c2a940a2934fec4d75c7c9b2, State: Initialized, Role: FOLLOWER
I20260809 16:15:51.919967 31950 consensus_queue.cc:260] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:51.920226 31950 ts_tablet_manager.cc:1428] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:15:51.920262 31918 heartbeater.cc:503] Master 127.27.217.62:45659 was elected leader, sending a full tablet report...
I20260809 16:15:51.920346 31956 tablet_bootstrap.cc:492] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Bootstrap starting.
I20260809 16:15:51.920913 31956 tablet_bootstrap.cc:654] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:51.921234 31956 log.cc:824] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:51.921809 31956 tablet_bootstrap.cc:492] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: No bootstrap required, opened a new log
I20260809 16:15:51.921861 31956 ts_tablet_manager.cc:1397] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:51.923136 31956 raft_consensus.cc:348] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:51.923250 31956 raft_consensus.cc:374] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:51.923280 31956 raft_consensus.cc:729] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ce8857dafc644e5aff4a514e7da61e5, State: Initialized, Role: FOLLOWER
I20260809 16:15:51.923382 31956 consensus_queue.cc:260] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:51.923620 31956 ts_tablet_manager.cc:1428] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:15:51.923658 31696 heartbeater.cc:503] Master 127.27.217.62:45659 was elected leader, sending a full tablet report...
W20260809 16:15:51.958990 31697 tablet.cc:2369] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:15:52.057955 31490 tablet.cc:2369] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:15:52.114035 31921 tablet.cc:2369] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:15:52.283725 31952 raft_consensus.cc:482] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:52.283854 31952 raft_consensus.cc:504] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:52.284287 31952 leader_election.cc:288] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587), 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355)
I20260809 16:15:52.288132 31947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.284607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:36095 (local address 127.27.217.3:38587)
0809 16:15:52.284655 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.284656 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.284692 (+ 36us) server_negotiation.cc:407] Connection header received
0809 16:15:52.284769 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.284769 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.284777 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.284847 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:52.285005 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.285755 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.287205 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.287789 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.287857 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.287865 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.288018 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.288058 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:15:52.288132 31946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.284587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:51469 (local address 127.27.217.2:41355)
0809 16:15:52.284642 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.284644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.284694 (+ 50us) server_negotiation.cc:407] Connection header received
0809 16:15:52.284765 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.284766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.284775 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.284847 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:52.285005 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.285753 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.287203 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.287784 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.287857 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.287865 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.288018 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.288058 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:15:52.288173 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.284496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:38587 (local address 127.27.217.1:36095)
0809 16:15:52.284628 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:52.284639 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:52.284707 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:52.284863 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:52.284863 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:52.284866 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:52.284941 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.284943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.285834 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.285834 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.287119 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.287122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.287858 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.287859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.287947 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.287952 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:15:52.288007 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 16:15:52.288059 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":53,"thread_start_us":69,"threads_started":1}
I20260809 16:15:52.288173 31964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.284496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:41355 (local address 127.27.217.1:51469)
0809 16:15:52.284628 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:52.284639 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:52.284707 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:52.284863 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:52.284864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:52.284868 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:52.284943 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.284944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.285831 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.285832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.287119 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.287122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.287859 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.287860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.287947 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.287953 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 16:15:52.288007 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 16:15:52.288060 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":58,"thread_start_us":66,"threads_started":1}
I20260809 16:15:52.288548 31847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4de9bf74da345b19d4d6ad0f9989964" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" is_pre_election: true
I20260809 16:15:52.288658 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4de9bf74da345b19d4d6ad0f9989964" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5" is_pre_election: true
I20260809 16:15:52.288718 31847 raft_consensus.cc:2454] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 0.
I20260809 16:15:52.288789 31629 raft_consensus.cc:2454] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 0.
I20260809 16:15:52.288964 31324 leader_election.cc:302] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ceba6675c2a940a2934fec4d75c7c9b2, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:52.289108 31952 raft_consensus.cc:2781] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:52.289170 31952 raft_consensus.cc:482] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:52.289186 31952 raft_consensus.cc:3037] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.289927 31952 raft_consensus.cc:504] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:52.290055 31952 leader_election.cc:288] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 election: Requested vote from peers ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587), 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355)
I20260809 16:15:52.290198 31847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4de9bf74da345b19d4d6ad0f9989964" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceba6675c2a940a2934fec4d75c7c9b2"
I20260809 16:15:52.290194 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4de9bf74da345b19d4d6ad0f9989964" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5"
I20260809 16:15:52.290273 31847 raft_consensus.cc:3037] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.290277 31629 raft_consensus.cc:3037] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.290989 31629 raft_consensus.cc:2454] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 1.
I20260809 16:15:52.290992 31847 raft_consensus.cc:2454] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 1.
I20260809 16:15:52.291141 31324 leader_election.cc:302] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ceba6675c2a940a2934fec4d75c7c9b2, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:52.291231 31952 raft_consensus.cc:2781] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:52.291353 31952 raft_consensus.cc:686] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 1 LEADER]: Becoming Leader. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Running, Role: LEADER
I20260809 16:15:52.291450 31952 consensus_queue.cc:237] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } }
I20260809 16:15:52.292346 31172 catalog_manager.cc:5495] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a reported cstate change: term changed from 0 to 1, leader changed from <none> to f329136214454bb9bf49070ffbd1201a (127.27.217.1). New cstate: current_term: 1 leader_uuid: "f329136214454bb9bf49070ffbd1201a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } health_report { overall_health: UNKNOWN } } }
Aug 09 16:15:52 dist-test-slave-nj21 krb5kdc[31107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292151, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:52.374349 31975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.368285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45659 (local address 127.0.0.1:48776)
0809 16:15:52.368454 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:52.368463 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:52.368519 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:52.368625 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:52.368626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:52.368916 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:52.368963 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.368966 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.369554 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.369555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.370068 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.370069 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.370337 (+ 268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.370337 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.370372 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.370855 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:52.370859 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:52.372172 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:52.373449 (+ 1277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:52.373457 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:52.373460 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:52.373650 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:52.373860 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:52.373860 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:52.373861 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:52.373911 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:52.374093 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:52.374098 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:52.374138 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 16:15:52.374188 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 16:15:52.374276 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
I20260809 16:15:52.374411 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.368324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48776 (local address 127.27.217.62:45659)
0809 16:15:52.368377 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.368380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.368514 (+ 134us) server_negotiation.cc:407] Connection header received
0809 16:15:52.368557 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.368557 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.368566 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.368612 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:52.369019 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.369501 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.370120 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.370290 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.370335 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.372263 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:52.372264 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:52.372265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:52.372271 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:52.373368 (+ 1097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:52.373732 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:52.373733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:52.373734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:52.373802 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:52.373953 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:52.373953 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:52.373953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:52.374049 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:52.374094 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.374210 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.374325 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":29}
I20260809 16:15:52.376160 31172 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:48776:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 16:15:52.376336 31172 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:52.377684 31802 tablet_service.cc:1467] Processing CreateTablet for tablet 44c6421bc9944ad2a88551038fbca7aa (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=aac65920a90e4b8bb5728e5a434d5829]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:15:52.377718 31592 tablet_service.cc:1467] Processing CreateTablet for tablet 44c6421bc9944ad2a88551038fbca7aa (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=aac65920a90e4b8bb5728e5a434d5829]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:15:52.377871 31802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c6421bc9944ad2a88551038fbca7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:52.377879 31592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c6421bc9944ad2a88551038fbca7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:52.379386 31956 tablet_bootstrap.cc:492] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: Bootstrap starting.
I20260809 16:15:52.379583 31388 tablet_service.cc:1467] Processing CreateTablet for tablet 44c6421bc9944ad2a88551038fbca7aa (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=aac65920a90e4b8bb5728e5a434d5829]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:15:52.379748 31950 tablet_bootstrap.cc:492] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: Bootstrap starting.
I20260809 16:15:52.379805 31956 tablet_bootstrap.cc:654] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:52.380118 31950 tablet_bootstrap.cc:654] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:52.380419 31956 tablet_bootstrap.cc:492] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: No bootstrap required, opened a new log
I20260809 16:15:52.380467 31956 ts_tablet_manager.cc:1397] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:15:52.380555 31388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c6421bc9944ad2a88551038fbca7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:52.380631 31956 raft_consensus.cc:348] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.380709 31956 raft_consensus.cc:374] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:52.380730 31956 raft_consensus.cc:729] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ce8857dafc644e5aff4a514e7da61e5, State: Initialized, Role: FOLLOWER
I20260809 16:15:52.380774 31956 consensus_queue.cc:260] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.380873 31950 tablet_bootstrap.cc:492] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: No bootstrap required, opened a new log
I20260809 16:15:52.380890 31956 ts_tablet_manager.cc:1428] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:52.380923 31950 ts_tablet_manager.cc:1397] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:15:52.381064 31950 raft_consensus.cc:348] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.381142 31950 raft_consensus.cc:374] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:52.381165 31950 raft_consensus.cc:729] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceba6675c2a940a2934fec4d75c7c9b2, State: Initialized, Role: FOLLOWER
I20260809 16:15:52.381209 31950 consensus_queue.cc:260] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.381322 31950 ts_tablet_manager.cc:1428] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:52.381470 31955 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.381543 31955 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:52.381991 31948 tablet_bootstrap.cc:492] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: Bootstrap starting.
I20260809 16:15:52.382076 31963 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.382162 31963 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:52.382367 31948 tablet_bootstrap.cc:654] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:52.383139 31948 tablet_bootstrap.cc:492] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: No bootstrap required, opened a new log
I20260809 16:15:52.383178 31948 ts_tablet_manager.cc:1397] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:15:52.383281 31948 raft_consensus.cc:348] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.383329 31948 raft_consensus.cc:374] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:52.383342 31948 raft_consensus.cc:729] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Initialized, Role: FOLLOWER
I20260809 16:15:52.383374 31948 consensus_queue.cc:260] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.383455 31948 ts_tablet_manager.cc:1428] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:52.383507 31952 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.383600 31952 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:52.562040 31955 raft_consensus.cc:482] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:52.562139 31955 raft_consensus.cc:504] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.562458 31955 leader_election.cc:288] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f329136214454bb9bf49070ffbd1201a (127.27.217.1:43147), 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355)
I20260809 16:15:52.565267 31982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.562617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:43147 (local address 127.27.217.3:55711)
0809 16:15:52.562737 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:52.562748 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:52.562802 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:52.562955 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:52.562956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:52.562959 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:52.563022 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.563024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.563660 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.563661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.564516 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.564519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.565083 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.565084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.565132 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.565135 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:15:52.565174 (+ 39us) client_negotiation.cc:240] Negotiation successful
0809 16:15:52.565204 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
I20260809 16:15:52.565313 31983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.562685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:55711 (local address 127.27.217.1:43147)
0809 16:15:52.562782 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.562784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.562794 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:15:52.562857 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.562858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.562868 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.562945 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:52.563087 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.563591 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.564601 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.564970 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.565036 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.565045 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.565191 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.565233 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":43,"threads_started":1}
I20260809 16:15:52.565531 31419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c6421bc9944ad2a88551038fbca7aa" candidate_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329136214454bb9bf49070ffbd1201a" is_pre_election: true
I20260809 16:15:52.565632 31946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.562876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:43269 (local address 127.27.217.2:41355)
0809 16:15:52.562929 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.562931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.562939 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:15:52.562984 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.562984 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.562993 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.563046 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:15:52.563189 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.563645 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.564609 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.564962 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.565020 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.565030 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.565554 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.565586 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:15:52.565665 31985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.562797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:41355 (local address 127.27.217.3:43269)
0809 16:15:52.562879 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:52.562890 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:52.562931 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:52.563055 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:52.563055 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:52.563057 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:15:52.563130 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.563132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.563744 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.563745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.564524 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.564526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.565321 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.565402 (+ 81us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.565483 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.565488 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:15:52.565543 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 16:15:52.565581 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":42,"thread_start_us":37,"threads_started":1}
I20260809 16:15:52.565665 31419 raft_consensus.cc:2454] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceba6675c2a940a2934fec4d75c7c9b2 in term 0.
I20260809 16:15:52.565820 31731 leader_election.cc:302] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ceba6675c2a940a2934fec4d75c7c9b2, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:52.565850 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c6421bc9944ad2a88551038fbca7aa" candidate_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5" is_pre_election: true
I20260809 16:15:52.565943 31629 raft_consensus.cc:2454] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceba6675c2a940a2934fec4d75c7c9b2 in term 0.
I20260809 16:15:52.565948 31955 raft_consensus.cc:2781] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:52.565994 31955 raft_consensus.cc:482] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:52.566011 31955 raft_consensus.cc:3037] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.566746 31955 raft_consensus.cc:504] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.566844 31955 leader_election.cc:288] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [CANDIDATE]: Term 1 election: Requested vote from peers f329136214454bb9bf49070ffbd1201a (127.27.217.1:43147), 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355)
I20260809 16:15:52.566993 31419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c6421bc9944ad2a88551038fbca7aa" candidate_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329136214454bb9bf49070ffbd1201a"
I20260809 16:15:52.567035 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c6421bc9944ad2a88551038fbca7aa" candidate_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5"
I20260809 16:15:52.567072 31419 raft_consensus.cc:3037] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.567093 31629 raft_consensus.cc:3037] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.567890 31629 raft_consensus.cc:2454] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceba6675c2a940a2934fec4d75c7c9b2 in term 1.
I20260809 16:15:52.567890 31419 raft_consensus.cc:2454] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceba6675c2a940a2934fec4d75c7c9b2 in term 1.
I20260809 16:15:52.568055 31731 leader_election.cc:302] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ceba6675c2a940a2934fec4d75c7c9b2, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:52.568132 31955 raft_consensus.cc:2781] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:52.568254 31955 raft_consensus.cc:686] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 LEADER]: Becoming Leader. State: Replica: ceba6675c2a940a2934fec4d75c7c9b2, State: Running, Role: LEADER
I20260809 16:15:52.568356 31955 consensus_queue.cc:237] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.568742 31988 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: TxnStatusTablet state changed. Reason: New leader ceba6675c2a940a2934fec4d75c7c9b2. Latest consensus state: current_term: 1 leader_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.568831 31988 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:15:52.569031 31991 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 16:15:52.569141 31991 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 16:15:52.569094 31172 catalog_manager.cc:5495] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3). New cstate: current_term: 1 leader_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } health_report { overall_health: HEALTHY } } }
I20260809 16:15:52.607286 31947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.605031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46512 (local address 127.27.217.3:38587)
0809 16:15:52.605094 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.605096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.605105 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:15:52.605138 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.605139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.605158 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.605211 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:52.605337 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.605813 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.606535 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.606736 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.606790 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.606964 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:52.607073 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:52.607142 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.607179 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.607205 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 16:15:52.607295 31975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.604920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:38587 (local address 127.0.0.1:46512)
0809 16:15:52.604989 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:52.605000 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:52.605040 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:52.605221 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:52.605222 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:52.605223 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:15:52.605278 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.605281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.605883 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.605885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.606459 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.606461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.606794 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.606795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.606862 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.606877 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:15:52.607128 (+ 251us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:15:52.607136 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 16:15:52.607176 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 16:15:52.607226 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 16:15:52.609241 31629 raft_consensus.cc:1261] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Refusing update from remote peer ceba6675c2a940a2934fec4d75c7c9b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:52.609257 31419 raft_consensus.cc:1261] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Refusing update from remote peer ceba6675c2a940a2934fec4d75c7c9b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:52.609576 31955 consensus_queue.cc:1035] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:52.609737 31988 consensus_queue.cc:1035] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:52.610913 31963 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: TxnStatusTablet state changed. Reason: New leader ceba6675c2a940a2934fec4d75c7c9b2. Latest consensus state: current_term: 1 leader_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.610904 31952 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: TxnStatusTablet state changed. Reason: New leader ceba6675c2a940a2934fec4d75c7c9b2. Latest consensus state: current_term: 1 leader_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.611001 31963 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:52.611003 31952 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:52.612170 31955 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.612252 31955 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:15:52.612982 31955 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.613052 31955 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P ceba6675c2a940a2934fec4d75c7c9b2: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:15:52.613463 31952 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.613546 31952 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P f329136214454bb9bf49070ffbd1201a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:52.612721 31999 mvcc.cc:205] Tried to move back new op lower bound from 7316652657084796928 to 7316652656920571904. Current Snapshot: MvccSnapshot[applied={T|T < 7316652657084796928}]
I20260809 16:15:52.614408 31963 tablet_replica.cc:439] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } } }
I20260809 16:15:52.614490 31963 tablet_replica.cc:442] T 44c6421bc9944ad2a88551038fbca7aa P 5ce8857dafc644e5aff4a514e7da61e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:15:52.617105 31983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.614574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.27.217.1:43147)
0809 16:15:52.614614 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.614616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.614623 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:15:52.614650 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.614650 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.614668 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.614726 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:52.614875 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.615599 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.616352 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.616653 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.616721 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.616809 (+ 88us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:52.616922 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:52.617001 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.617016 (+ 15us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.617038 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:15:52.621785 31947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.619315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:57239 (local address 127.27.217.3:38587)
0809 16:15:52.619353 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.619355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.619408 (+ 53us) server_negotiation.cc:407] Connection header received
0809 16:15:52.619476 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.619476 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.619484 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.619524 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:52.619635 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.620092 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.621163 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.621353 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.621414 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.621587 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:52.621610 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:52.621643 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.621717 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.621737 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:15:52.621845 32016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.619235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:38587 (local address 127.27.217.1:57239)
0809 16:15:52.619354 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:52.619365 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:52.619422 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:52.619527 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:52.619528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:52.619530 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:15:52.619587 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.619588 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.620159 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.620160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.621070 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.621073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.621426 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.621427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.621492 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.621506 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:15:52.621665 (+ 159us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:15:52.621667 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:15:52.621713 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 16:15:52.621758 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":60,"threads_started":1}
I20260809 16:15:52.624256 31629 raft_consensus.cc:1261] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Refusing update from remote peer f329136214454bb9bf49070ffbd1201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:52.624287 31847 raft_consensus.cc:1261] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Refusing update from remote peer f329136214454bb9bf49070ffbd1201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:52.624508 31966 consensus_queue.cc:1035] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:52.624658 31966 consensus_queue.cc:1035] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:52.625998 32000 mvcc.cc:205] Tried to move back new op lower bound from 7316652657147318272 to 7316652655786369024. Current Snapshot: MvccSnapshot[applied={T|T < 7316652657147318272}]
I20260809 16:15:52.626107 31998 mvcc.cc:205] Tried to move back new op lower bound from 7316652657147318272 to 7316652655786369024. Current Snapshot: MvccSnapshot[applied={T|T < 7316652657147318272}]
I20260809 16:15:52.638255 31983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.631107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:44713 (local address 127.27.217.1:43147)
0809 16:15:52.631143 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:52.631145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:52.635887 (+ 4742us) server_negotiation.cc:407] Connection header received
0809 16:15:52.635937 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:52.635938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:52.635947 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:52.635991 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:52.636097 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.636545 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.637598 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.637836 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.637887 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.638080 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:52.638105 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:52.638134 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:52.638187 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 16:15:52.638203 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:15:52.638337 32027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:52.631054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:43147 (local address 127.27.217.3:44713)
0809 16:15:52.635810 (+ 4756us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:52.635823 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:52.635892 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:52.635995 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:52.635995 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:52.635997 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:15:52.636045 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.636046 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.636616 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.636617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.637522 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:52.637526 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:52.637926 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:52.637927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:52.637993 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:52.638007 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:15:52.638139 (+ 132us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:15:52.638141 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:15:52.638186 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 16:15:52.638229 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4717,"thread_start_us":77,"threads_started":1}
I20260809 16:15:52.646204 31171 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:52.646322 31171 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:52.647102 31171 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: Sending DeleteTablet for 3 replicas of tablet e4de9bf74da345b19d4d6ad0f9989964
I20260809 16:15:52.647514 31802 tablet_service.cc:1514] Processing DeleteTablet for tablet e4de9bf74da345b19d4d6ad0f9989964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:52 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:46498
I20260809 16:15:52.647569 31592 tablet_service.cc:1514] Processing DeleteTablet for tablet e4de9bf74da345b19d4d6ad0f9989964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:52 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:49178
I20260809 16:15:52.647794 31388 tablet_service.cc:1514] Processing DeleteTablet for tablet e4de9bf74da345b19d4d6ad0f9989964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:52 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:50498
I20260809 16:15:52.647917 32035 tablet_replica.cc:330] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: stopping tablet replica
I20260809 16:15:52.648059 32035 raft_consensus.cc:2229] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:52.648159 32035 raft_consensus.cc:2258] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:52.648293 31171 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:15:52.648449 31171 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:52.648778 32035 ts_tablet_manager.cc:1905] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:52.649570 31802 tablet_service.cc:1467] Processing CreateTablet for tablet 3c13633f9c3847318855ec8cc4b6722c (DEFAULT_TABLE table=test-table [id=df6d7778d0ba4582b5bbe0ce0b2de9b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:52.649704 31802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c13633f9c3847318855ec8cc4b6722c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:52.650761 32035 ts_tablet_manager.cc:1918] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:52.650902 32035 log.cc:1196] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/e4de9bf74da345b19d4d6ad0f9989964
I20260809 16:15:52.651145 31950 tablet_bootstrap.cc:492] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: Bootstrap starting.
I20260809 16:15:52.651304 32035 ts_tablet_manager.cc:1939] T e4de9bf74da345b19d4d6ad0f9989964 P 5ce8857dafc644e5aff4a514e7da61e5: Deleting consensus metadata
I20260809 16:15:52.651547 31950 tablet_bootstrap.cc:654] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:52.652251 31153 catalog_manager.cc:4841] TS 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355): tablet e4de9bf74da345b19d4d6ad0f9989964 (table test-table [id=044da236914a429190a6056eed00ed5c]) successfully deleted
I20260809 16:15:52.652592 31950 tablet_bootstrap.cc:492] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: No bootstrap required, opened a new log
I20260809 16:15:52.652606 31592 tablet_service.cc:1467] Processing CreateTablet for tablet 3c13633f9c3847318855ec8cc4b6722c (DEFAULT_TABLE table=test-table [id=df6d7778d0ba4582b5bbe0ce0b2de9b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:52.652643 31950 ts_tablet_manager.cc:1397] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:52.652709 31592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c13633f9c3847318855ec8cc4b6722c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:52.652779 31950 raft_consensus.cc:348] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.652842 31950 raft_consensus.cc:374] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:52.652861 31950 raft_consensus.cc:729] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceba6675c2a940a2934fec4d75c7c9b2, State: Initialized, Role: FOLLOWER
I20260809 16:15:52.652901 31950 consensus_queue.cc:260] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.652992 31950 ts_tablet_manager.cc:1428] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:52.654043 31956 tablet_bootstrap.cc:492] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: Bootstrap starting.
I20260809 16:15:52.654255 31388 tablet_service.cc:1467] Processing CreateTablet for tablet 3c13633f9c3847318855ec8cc4b6722c (DEFAULT_TABLE table=test-table [id=df6d7778d0ba4582b5bbe0ce0b2de9b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:52.654369 31388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c13633f9c3847318855ec8cc4b6722c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:52.654451 31956 tablet_bootstrap.cc:654] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:52.655447 31956 tablet_bootstrap.cc:492] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: No bootstrap required, opened a new log
I20260809 16:15:52.655493 31956 ts_tablet_manager.cc:1397] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:15:52.655627 31956 raft_consensus.cc:348] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.655711 31956 raft_consensus.cc:374] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:52.655731 31956 raft_consensus.cc:729] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ce8857dafc644e5aff4a514e7da61e5, State: Initialized, Role: FOLLOWER
I20260809 16:15:52.655766 32034 tablet_replica.cc:330] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: stopping tablet replica
I20260809 16:15:52.655768 31956 consensus_queue.cc:260] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.655850 31956 ts_tablet_manager.cc:1428] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:52.655872 32034 raft_consensus.cc:2229] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:52.655895 31948 tablet_bootstrap.cc:492] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: Bootstrap starting.
I20260809 16:15:52.655923 32034 raft_consensus.cc:2258] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:52.656291 31948 tablet_bootstrap.cc:654] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:52.656298 32034 ts_tablet_manager.cc:1905] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:52.656947 31948 tablet_bootstrap.cc:492] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: No bootstrap required, opened a new log
I20260809 16:15:52.657004 31948 ts_tablet_manager.cc:1397] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:15:52.657140 31948 raft_consensus.cc:348] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.657196 31948 raft_consensus.cc:374] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:52.657215 31948 raft_consensus.cc:729] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Initialized, Role: FOLLOWER
I20260809 16:15:52.657251 31948 consensus_queue.cc:260] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.657354 31948 ts_tablet_manager.cc:1428] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:52.657861 32036 tablet_replica.cc:330] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: stopping tablet replica
I20260809 16:15:52.657866 32034 ts_tablet_manager.cc:1918] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:52.657927 32034 log.cc:1196] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/e4de9bf74da345b19d4d6ad0f9989964
I20260809 16:15:52.658104 32036 raft_consensus.cc:2229] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:15:52.658197 32034 ts_tablet_manager.cc:1939] T e4de9bf74da345b19d4d6ad0f9989964 P ceba6675c2a940a2934fec4d75c7c9b2: Deleting consensus metadata
I20260809 16:15:52.658226 32036 raft_consensus.cc:2258] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:52.658613 32036 ts_tablet_manager.cc:1905] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:52.658599 31154 catalog_manager.cc:4841] TS ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587): tablet e4de9bf74da345b19d4d6ad0f9989964 (table test-table [id=044da236914a429190a6056eed00ed5c]) successfully deleted
I20260809 16:15:52.660431 32036 ts_tablet_manager.cc:1918] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:52.660509 32036 log.cc:1196] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/e4de9bf74da345b19d4d6ad0f9989964
I20260809 16:15:52.660830 32036 ts_tablet_manager.cc:1939] T e4de9bf74da345b19d4d6ad0f9989964 P f329136214454bb9bf49070ffbd1201a: Deleting consensus metadata
I20260809 16:15:52.661222 31153 catalog_manager.cc:4841] TS f329136214454bb9bf49070ffbd1201a (127.27.217.1:43147): tablet e4de9bf74da345b19d4d6ad0f9989964 (table test-table [id=044da236914a429190a6056eed00ed5c]) successfully deleted
I20260809 16:15:52.754878 32022 raft_consensus.cc:482] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:52.754967 32022 raft_consensus.cc:504] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.755102 32022 leader_election.cc:288] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355), ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587)
I20260809 16:15:52.755288 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c13633f9c3847318855ec8cc4b6722c" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5" is_pre_election: true
I20260809 16:15:52.755398 31629 raft_consensus.cc:2454] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 0.
I20260809 16:15:52.755369 31847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c13633f9c3847318855ec8cc4b6722c" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" is_pre_election: true
I20260809 16:15:52.755463 31847 raft_consensus.cc:2454] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 0.
I20260809 16:15:52.755565 31322 leader_election.cc:302] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ce8857dafc644e5aff4a514e7da61e5, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:52.755692 32022 raft_consensus.cc:2781] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:52.755726 32022 raft_consensus.cc:482] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:52.755752 32022 raft_consensus.cc:3037] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.756470 32022 raft_consensus.cc:504] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.756594 32022 leader_election.cc:288] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 election: Requested vote from peers 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355), ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587)
I20260809 16:15:52.756729 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c13633f9c3847318855ec8cc4b6722c" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5"
I20260809 16:15:52.756816 31629 raft_consensus.cc:3037] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.756804 31847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c13633f9c3847318855ec8cc4b6722c" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceba6675c2a940a2934fec4d75c7c9b2"
I20260809 16:15:52.756879 31847 raft_consensus.cc:3037] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:52.757532 31847 raft_consensus.cc:2454] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 1.
I20260809 16:15:52.757614 31629 raft_consensus.cc:2454] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 1.
I20260809 16:15:52.757723 31324 leader_election.cc:302] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ceba6675c2a940a2934fec4d75c7c9b2, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:52.757818 32022 raft_consensus.cc:2781] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:52.757874 32022 raft_consensus.cc:686] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 1 LEADER]: Becoming Leader. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Running, Role: LEADER
I20260809 16:15:52.757925 32022 consensus_queue.cc:237] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:52.758553 31171 catalog_manager.cc:5495] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a reported cstate change: term changed from 0 to 1, leader changed from <none> to f329136214454bb9bf49070ffbd1201a (127.27.217.1). New cstate: current_term: 1 leader_uuid: "f329136214454bb9bf49070ffbd1201a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } health_report { overall_health: UNKNOWN } } }
I20260809 16:15:52.777624 31847 raft_consensus.cc:1261] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Refusing update from remote peer f329136214454bb9bf49070ffbd1201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:52.777658 31629 raft_consensus.cc:1261] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Refusing update from remote peer f329136214454bb9bf49070ffbd1201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:52.777812 31952 consensus_queue.cc:1035] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:52.777902 32022 consensus_queue.cc:1035] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 16:15:52.782491 32000 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 16:15:54.299063 31172 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:54.299168 31172 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:54.299927 31172 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: Sending DeleteTablet for 3 replicas of tablet 3c13633f9c3847318855ec8cc4b6722c
I20260809 16:15:54.300174 31388 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c13633f9c3847318855ec8cc4b6722c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:54 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:50498
I20260809 16:15:54.300182 31592 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c13633f9c3847318855ec8cc4b6722c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:54 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:49178
I20260809 16:15:54.300374 32079 tablet_replica.cc:330] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: stopping tablet replica
I20260809 16:15:54.300431 32079 raft_consensus.cc:2229] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:15:54.300484 32079 raft_consensus.cc:2258] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:54.300587 32081 tablet_replica.cc:330] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: stopping tablet replica
I20260809 16:15:54.300648 32081 raft_consensus.cc:2229] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:54.300686 32081 raft_consensus.cc:2258] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:54.300822 32079 ts_tablet_manager.cc:1905] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:54.300899 32081 ts_tablet_manager.cc:1905] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:54.301997 31809 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c13633f9c3847318855ec8cc4b6722c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:54 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:46498
I20260809 16:15:54.302556 32084 tablet_replica.cc:330] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: stopping tablet replica
I20260809 16:15:54.302661 32084 raft_consensus.cc:2229] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:54.302662 32079 ts_tablet_manager.cc:1918] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 16:15:54.302711 32079 log.cc:1196] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/3c13633f9c3847318855ec8cc4b6722c
I20260809 16:15:54.302789 32084 raft_consensus.cc:2258] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:54.302935 32079 ts_tablet_manager.cc:1939] T 3c13633f9c3847318855ec8cc4b6722c P f329136214454bb9bf49070ffbd1201a: Deleting consensus metadata
I20260809 16:15:54.303126 32084 ts_tablet_manager.cc:1905] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:54.303259 32081 ts_tablet_manager.cc:1918] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 16:15:54.303314 32081 log.cc:1196] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/3c13633f9c3847318855ec8cc4b6722c
I20260809 16:15:54.303287 31153 catalog_manager.cc:4841] TS f329136214454bb9bf49070ffbd1201a (127.27.217.1:43147): tablet 3c13633f9c3847318855ec8cc4b6722c (table test-table [id=df6d7778d0ba4582b5bbe0ce0b2de9b0]) successfully deleted
I20260809 16:15:54.303508 32081 ts_tablet_manager.cc:1939] T 3c13633f9c3847318855ec8cc4b6722c P 5ce8857dafc644e5aff4a514e7da61e5: Deleting consensus metadata
I20260809 16:15:54.303802 31153 catalog_manager.cc:4841] TS 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355): tablet 3c13633f9c3847318855ec8cc4b6722c (table test-table [id=df6d7778d0ba4582b5bbe0ce0b2de9b0]) successfully deleted
I20260809 16:15:54.304752 32084 ts_tablet_manager.cc:1918] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 16:15:54.304811 32084 log.cc:1196] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/3c13633f9c3847318855ec8cc4b6722c
I20260809 16:15:54.305023 32084 ts_tablet_manager.cc:1939] T 3c13633f9c3847318855ec8cc4b6722c P ceba6675c2a940a2934fec4d75c7c9b2: Deleting consensus metadata
I20260809 16:15:54.305306 31154 catalog_manager.cc:4841] TS ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587): tablet 3c13633f9c3847318855ec8cc4b6722c (table test-table [id=df6d7778d0ba4582b5bbe0ce0b2de9b0]) successfully deleted
Aug 09 16:15:54 dist-test-slave-nj21 krb5kdc[31107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292154, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 16:15:54 dist-test-slave-nj21 krb5kdc[31107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292154, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:54.327351 32098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:54.317920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48778 (local address 127.27.217.62:45659)
0809 16:15:54.318040 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:54.318042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:54.318054 (+ 12us) server_negotiation.cc:407] Connection header received
0809 16:15:54.318119 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:54.318120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:54.318129 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:54.318195 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:54.318690 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:54.319194 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:54.319909 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:54.320112 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:54.320156 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:54.325215 (+ 5059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:54.325216 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:54.325216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:54.325222 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:54.326540 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:54.326807 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:54.326807 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:54.326808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:54.326860 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:54.326993 (+ 133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:54.326994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:54.326994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:54.327085 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:54.327154 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:54.327224 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 16:15:54.327285 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260809 16:15:54.328720 31172 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:15:54.328858 31172 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:54.330076 31592 tablet_service.cc:1467] Processing CreateTablet for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 (DEFAULT_TABLE table=test-table [id=dc094a82c83d436a9d85554fc7b6532b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:54.330070 31388 tablet_service.cc:1467] Processing CreateTablet for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 (DEFAULT_TABLE table=test-table [id=dc094a82c83d436a9d85554fc7b6532b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:54.330111 31809 tablet_service.cc:1467] Processing CreateTablet for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 (DEFAULT_TABLE table=test-table [id=dc094a82c83d436a9d85554fc7b6532b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:54.330202 31592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:54.330199 31388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:54.330255 31809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:54.331403 32100 tablet_bootstrap.cc:492] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: Bootstrap starting.
I20260809 16:15:54.331562 32103 tablet_bootstrap.cc:492] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: Bootstrap starting.
I20260809 16:15:54.331908 32101 tablet_bootstrap.cc:492] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: Bootstrap starting.
I20260809 16:15:54.331924 32100 tablet_bootstrap.cc:654] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:54.331998 32103 tablet_bootstrap.cc:654] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:54.332273 32101 tablet_bootstrap.cc:654] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:54.332508 32100 tablet_bootstrap.cc:492] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: No bootstrap required, opened a new log
I20260809 16:15:54.332562 32100 ts_tablet_manager.cc:1397] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:15:54.332679 32100 raft_consensus.cc:348] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.332755 32100 raft_consensus.cc:374] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:54.332773 32100 raft_consensus.cc:729] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceba6675c2a940a2934fec4d75c7c9b2, State: Initialized, Role: FOLLOWER
I20260809 16:15:54.332821 32100 consensus_queue.cc:260] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.332834 32101 tablet_bootstrap.cc:492] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: No bootstrap required, opened a new log
I20260809 16:15:54.332882 32101 ts_tablet_manager.cc:1397] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:15:54.332923 32100 ts_tablet_manager.cc:1428] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:54.333022 32101 raft_consensus.cc:348] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.333097 32101 raft_consensus.cc:374] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:54.333124 32101 raft_consensus.cc:729] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ce8857dafc644e5aff4a514e7da61e5, State: Initialized, Role: FOLLOWER
I20260809 16:15:54.333187 32101 consensus_queue.cc:260] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.333236 32103 tablet_bootstrap.cc:492] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: No bootstrap required, opened a new log
I20260809 16:15:54.333284 32103 ts_tablet_manager.cc:1397] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:15:54.333346 32101 ts_tablet_manager.cc:1428] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:54.333400 32103 raft_consensus.cc:348] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.333474 32103 raft_consensus.cc:374] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:54.333503 32103 raft_consensus.cc:729] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Initialized, Role: FOLLOWER
I20260809 16:15:54.333551 32103 consensus_queue.cc:260] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.333683 32103 ts_tablet_manager.cc:1428] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:54.479146 32071 raft_consensus.cc:482] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:54.479239 32071 raft_consensus.cc:504] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.479414 32071 leader_election.cc:288] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355), ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587)
I20260809 16:15:54.479614 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3a2c8dc7b4497cae902dad8b2e8af8" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5" is_pre_election: true
I20260809 16:15:54.479627 31847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3a2c8dc7b4497cae902dad8b2e8af8" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" is_pre_election: true
I20260809 16:15:54.479728 31629 raft_consensus.cc:2454] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 0.
I20260809 16:15:54.479768 31847 raft_consensus.cc:2454] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 0.
I20260809 16:15:54.479895 31322 leader_election.cc:302] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ce8857dafc644e5aff4a514e7da61e5, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:54.480036 32071 raft_consensus.cc:2781] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:54.480083 32071 raft_consensus.cc:482] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:54.480098 32071 raft_consensus.cc:3037] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:54.480801 32071 raft_consensus.cc:504] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.480919 32071 leader_election.cc:288] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 election: Requested vote from peers 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355), ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587)
I20260809 16:15:54.481077 31847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3a2c8dc7b4497cae902dad8b2e8af8" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceba6675c2a940a2934fec4d75c7c9b2"
I20260809 16:15:54.481143 31847 raft_consensus.cc:3037] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:54.481123 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a3a2c8dc7b4497cae902dad8b2e8af8" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5"
I20260809 16:15:54.481181 31629 raft_consensus.cc:3037] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:54.481750 31847 raft_consensus.cc:2454] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 1.
I20260809 16:15:54.481823 31629 raft_consensus.cc:2454] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 1.
I20260809 16:15:54.481957 31324 leader_election.cc:302] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ceba6675c2a940a2934fec4d75c7c9b2, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:54.482048 32071 raft_consensus.cc:2781] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:54.482108 32071 raft_consensus.cc:686] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 1 LEADER]: Becoming Leader. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Running, Role: LEADER
I20260809 16:15:54.482177 32071 consensus_queue.cc:237] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.482782 31172 catalog_manager.cc:5495] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a reported cstate change: term changed from 0 to 1, leader changed from <none> to f329136214454bb9bf49070ffbd1201a (127.27.217.1). New cstate: current_term: 1 leader_uuid: "f329136214454bb9bf49070ffbd1201a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } health_report { overall_health: UNKNOWN } } }
I20260809 16:15:54.515244 32115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:54.513207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50522 (local address 127.27.217.1:43147)
0809 16:15:54.513358 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:54.513360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:54.513368 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:15:54.513388 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:54.513389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:54.513399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:54.513457 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:15:54.513580 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:54.514052 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:54.514740 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:54.514927 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:54.514970 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:54.515069 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:15:54.515094 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:15:54.515125 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:54.515154 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 16:15:54.515171 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260809 16:15:54.517263 31847 raft_consensus.cc:1261] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Refusing update from remote peer f329136214454bb9bf49070ffbd1201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:54.517288 31629 raft_consensus.cc:1261] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Refusing update from remote peer f329136214454bb9bf49070ffbd1201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:54.517482 32067 consensus_queue.cc:1035] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:54.517597 32071 consensus_queue.cc:1035] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:54.526813 31171 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:54.526901 31171 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:54.527405 31171 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: Sending DeleteTablet for 3 replicas of tablet 4a3a2c8dc7b4497cae902dad8b2e8af8
I20260809 16:15:54.527632 31388 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:54 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:50498
I20260809 16:15:54.527640 31592 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:54 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:49178
I20260809 16:15:54.527699 31809 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:54 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:46498
I20260809 16:15:54.527750 32081 tablet_replica.cc:330] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: stopping tablet replica
I20260809 16:15:54.527778 32084 tablet_replica.cc:330] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: stopping tablet replica
I20260809 16:15:54.527747 32079 tablet_replica.cc:330] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: stopping tablet replica
I20260809 16:15:54.527802 32081 raft_consensus.cc:2229] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:54.527825 32084 raft_consensus.cc:2229] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:54.527832 32079 raft_consensus.cc:2229] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:15:54.527839 32081 raft_consensus.cc:2258] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:54.527866 32084 raft_consensus.cc:2258] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:54.527880 32079 raft_consensus.cc:2258] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:54.527951 31171 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:15:54.528090 31171 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:15:54.528168 32079 ts_tablet_manager.cc:1905] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:54.528285 32081 ts_tablet_manager.cc:1905] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:54.529152 31809 tablet_service.cc:1467] Processing CreateTablet for tablet 4df369ddb39b4c0c993dadfbc2f3615a (DEFAULT_TABLE table=test-table [id=b6e38ec8d8914ada98ac4a013b66d907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:54.529282 31809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df369ddb39b4c0c993dadfbc2f3615a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:54.529735 31388 tablet_service.cc:1467] Processing CreateTablet for tablet 4df369ddb39b4c0c993dadfbc2f3615a (DEFAULT_TABLE table=test-table [id=b6e38ec8d8914ada98ac4a013b66d907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:54.529875 32084 ts_tablet_manager.cc:1905] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:54.530714 32100 tablet_bootstrap.cc:492] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: Bootstrap starting.
I20260809 16:15:54.530727 31592 tablet_service.cc:1467] Processing CreateTablet for tablet 4df369ddb39b4c0c993dadfbc2f3615a (DEFAULT_TABLE table=test-table [id=b6e38ec8d8914ada98ac4a013b66d907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:15:54.530869 32081 ts_tablet_manager.cc:1918] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:54.530928 32081 log.cc:1196] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/4a3a2c8dc7b4497cae902dad8b2e8af8
I20260809 16:15:54.531018 32084 ts_tablet_manager.cc:1918] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:54.531041 32100 tablet_bootstrap.cc:654] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:54.531087 32084 log.cc:1196] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/4a3a2c8dc7b4497cae902dad8b2e8af8
I20260809 16:15:54.531136 32081 ts_tablet_manager.cc:1939] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P 5ce8857dafc644e5aff4a514e7da61e5: Deleting consensus metadata
I20260809 16:15:54.531276 31592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df369ddb39b4c0c993dadfbc2f3615a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:54.531319 32084 ts_tablet_manager.cc:1939] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P ceba6675c2a940a2934fec4d75c7c9b2: Deleting consensus metadata
I20260809 16:15:54.531579 31154 catalog_manager.cc:4841] TS ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587): tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 (table test-table [id=dc094a82c83d436a9d85554fc7b6532b]) successfully deleted
I20260809 16:15:54.531598 31153 catalog_manager.cc:4841] TS 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355): tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 (table test-table [id=dc094a82c83d436a9d85554fc7b6532b]) successfully deleted
I20260809 16:15:54.531808 32079 ts_tablet_manager.cc:1918] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:15:54.531831 31388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df369ddb39b4c0c993dadfbc2f3615a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:54.531857 32079 log.cc:1196] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/4a3a2c8dc7b4497cae902dad8b2e8af8
I20260809 16:15:54.532074 32079 ts_tablet_manager.cc:1939] T 4a3a2c8dc7b4497cae902dad8b2e8af8 P f329136214454bb9bf49070ffbd1201a: Deleting consensus metadata
I20260809 16:15:54.532361 31153 catalog_manager.cc:4841] TS f329136214454bb9bf49070ffbd1201a (127.27.217.1:43147): tablet 4a3a2c8dc7b4497cae902dad8b2e8af8 (table test-table [id=dc094a82c83d436a9d85554fc7b6532b]) successfully deleted
I20260809 16:15:54.532603 32100 tablet_bootstrap.cc:492] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: No bootstrap required, opened a new log
I20260809 16:15:54.532644 32100 ts_tablet_manager.cc:1397] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 16:15:54.532763 32100 raft_consensus.cc:348] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.532819 32100 raft_consensus.cc:374] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:54.532831 32100 raft_consensus.cc:729] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceba6675c2a940a2934fec4d75c7c9b2, State: Initialized, Role: FOLLOWER
I20260809 16:15:54.532862 32100 consensus_queue.cc:260] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.532951 32100 ts_tablet_manager.cc:1428] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:54.532985 32101 tablet_bootstrap.cc:492] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: Bootstrap starting.
I20260809 16:15:54.533639 32101 tablet_bootstrap.cc:654] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:54.533952 32103 tablet_bootstrap.cc:492] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a: Bootstrap starting.
I20260809 16:15:54.534237 32103 tablet_bootstrap.cc:654] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:54.534262 32101 tablet_bootstrap.cc:492] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: No bootstrap required, opened a new log
I20260809 16:15:54.534299 32101 ts_tablet_manager.cc:1397] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:15:54.534462 32101 raft_consensus.cc:348] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.534538 32101 raft_consensus.cc:374] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:54.534564 32101 raft_consensus.cc:729] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ce8857dafc644e5aff4a514e7da61e5, State: Initialized, Role: FOLLOWER
I20260809 16:15:54.534603 32101 consensus_queue.cc:260] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.534695 32101 ts_tablet_manager.cc:1428] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 16:15:54.534891 32103 tablet_bootstrap.cc:492] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a: No bootstrap required, opened a new log
I20260809 16:15:54.534950 32103 ts_tablet_manager.cc:1397] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:15:54.535063 32103 raft_consensus.cc:348] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.535121 32103 raft_consensus.cc:374] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:54.535133 32103 raft_consensus.cc:729] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Initialized, Role: FOLLOWER
I20260809 16:15:54.535168 32103 consensus_queue.cc:260] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.535252 32103 ts_tablet_manager.cc:1428] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:54.545441 32071 raft_consensus.cc:482] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:15:54.545498 32071 raft_consensus.cc:504] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.545619 32071 leader_election.cc:288] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355), ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587)
I20260809 16:15:54.545773 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df369ddb39b4c0c993dadfbc2f3615a" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5" is_pre_election: true
I20260809 16:15:54.545775 31847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df369ddb39b4c0c993dadfbc2f3615a" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" is_pre_election: true
I20260809 16:15:54.545838 31629 raft_consensus.cc:2454] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 0.
I20260809 16:15:54.545846 31847 raft_consensus.cc:2454] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 0.
I20260809 16:15:54.545971 31322 leader_election.cc:302] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ce8857dafc644e5aff4a514e7da61e5, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:54.546049 32071 raft_consensus.cc:2781] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:15:54.546098 32071 raft_consensus.cc:482] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:15:54.546121 32071 raft_consensus.cc:3037] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:54.546648 32071 raft_consensus.cc:504] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.546757 32071 leader_election.cc:288] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 election: Requested vote from peers 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355), ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587)
I20260809 16:15:54.546877 31847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df369ddb39b4c0c993dadfbc2f3615a" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceba6675c2a940a2934fec4d75c7c9b2"
I20260809 16:15:54.546882 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df369ddb39b4c0c993dadfbc2f3615a" candidate_uuid: "f329136214454bb9bf49070ffbd1201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ce8857dafc644e5aff4a514e7da61e5"
I20260809 16:15:54.546936 31847 raft_consensus.cc:3037] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:54.546954 31629 raft_consensus.cc:3037] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:54.547446 31847 raft_consensus.cc:2454] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 1.
I20260809 16:15:54.547531 31629 raft_consensus.cc:2454] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329136214454bb9bf49070ffbd1201a in term 1.
I20260809 16:15:54.547609 31324 leader_election.cc:302] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ceba6675c2a940a2934fec4d75c7c9b2, f329136214454bb9bf49070ffbd1201a; no voters:
I20260809 16:15:54.547725 32071 raft_consensus.cc:2781] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:54.547773 32071 raft_consensus.cc:686] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [term 1 LEADER]: Becoming Leader. State: Replica: f329136214454bb9bf49070ffbd1201a, State: Running, Role: LEADER
I20260809 16:15:54.547807 32071 consensus_queue.cc:237] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } }
I20260809 16:15:54.548264 31171 catalog_manager.cc:5495] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a reported cstate change: term changed from 0 to 1, leader changed from <none> to f329136214454bb9bf49070ffbd1201a (127.27.217.1). New cstate: current_term: 1 leader_uuid: "f329136214454bb9bf49070ffbd1201a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329136214454bb9bf49070ffbd1201a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 } health_report { overall_health: UNKNOWN } } }
I20260809 16:15:54.556951 31847 raft_consensus.cc:1261] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Refusing update from remote peer f329136214454bb9bf49070ffbd1201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:54.557029 31629 raft_consensus.cc:1261] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Refusing update from remote peer f329136214454bb9bf49070ffbd1201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:15:54.557176 32071 consensus_queue.cc:1035] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceba6675c2a940a2934fec4d75c7c9b2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 38587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:15:54.557284 32071 consensus_queue.cc:1035] T 4df369ddb39b4c0c993dadfbc2f3615a P f329136214454bb9bf49070ffbd1201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ce8857dafc644e5aff4a514e7da61e5" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 16:15:54.561086 32050 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 16:15:56.077345 31172 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:56.077455 31172 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:15:56.078320 31172 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3be6758fda3443cc8eaa696e7166687a: Sending DeleteTablet for 3 replicas of tablet 4df369ddb39b4c0c993dadfbc2f3615a
I20260809 16:15:56.078595 31592 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df369ddb39b4c0c993dadfbc2f3615a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:56 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:49178
I20260809 16:15:56.078629 31802 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df369ddb39b4c0c993dadfbc2f3615a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:56 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:46498
I20260809 16:15:56.078742 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31295
I20260809 16:15:56.078852 31388 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df369ddb39b4c0c993dadfbc2f3615a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:15:56 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:50498
I20260809 16:15:56.088963 32162 tablet_replica.cc:330] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: stopping tablet replica
I20260809 16:15:56.089053 32162 raft_consensus.cc:2229] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:56.089093 32162 raft_consensus.cc:2258] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:56.089203 32164 tablet_replica.cc:330] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: stopping tablet replica
I20260809 16:15:56.089267 32164 raft_consensus.cc:2229] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:15:56.089306 32164 raft_consensus.cc:2258] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:15:56.089521 32162 ts_tablet_manager.cc:1905] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:56.089561 32164 ts_tablet_manager.cc:1905] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:15:56.091341 32164 ts_tablet_manager.cc:1918] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 16:15:56.091341 32162 ts_tablet_manager.cc:1918] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 16:15:56.091411 32162 log.cc:1196] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/4df369ddb39b4c0c993dadfbc2f3615a
I20260809 16:15:56.091411 32164 log.cc:1196] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/4df369ddb39b4c0c993dadfbc2f3615a
I20260809 16:15:56.091647 32164 ts_tablet_manager.cc:1939] T 4df369ddb39b4c0c993dadfbc2f3615a P 5ce8857dafc644e5aff4a514e7da61e5: Deleting consensus metadata
I20260809 16:15:56.091647 32162 ts_tablet_manager.cc:1939] T 4df369ddb39b4c0c993dadfbc2f3615a P ceba6675c2a940a2934fec4d75c7c9b2: Deleting consensus metadata
I20260809 16:15:56.092046 31154 catalog_manager.cc:4841] TS ceba6675c2a940a2934fec4d75c7c9b2 (127.27.217.3:38587): tablet 4df369ddb39b4c0c993dadfbc2f3615a (table test-table [id=b6e38ec8d8914ada98ac4a013b66d907]) successfully deleted
I20260809 16:15:56.092099 31153 catalog_manager.cc:4841] TS 5ce8857dafc644e5aff4a514e7da61e5 (127.27.217.2:41355): tablet 4df369ddb39b4c0c993dadfbc2f3615a (table test-table [id=b6e38ec8d8914ada98ac4a013b66d907]) successfully deleted
W20260809 16:15:56.093076 31153 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:43147 (error 108)
I20260809 16:15:56.093321 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31501
I20260809 16:15:56.104912 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:56.093495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:43147 (local address 127.0.0.1:54204)
0809 16:15:56.104812 (+ 11317us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:56.104867 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11283,"thread_start_us":58,"threads_started":1}
I20260809 16:15:56.105033 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31708
W20260809 16:15:56.105085 31153 catalog_manager.cc:4584] TS f329136214454bb9bf49070ffbd1201a (127.27.217.1:43147): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4df369ddb39b4c0c993dadfbc2f3615a: Network error: Client connection negotiation failed: client connection to 127.27.217.1:43147: connect: Connection refused (error 111)
I20260809 16:15:56.113173 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31126
2026-08-09T16:15:56Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6111 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:15:56 dist-test-slave-nj21 krb5kdc[32170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:15:56 dist-test-slave-nj21 krb5kdc[32170](info): set up 2 sockets
Aug 09 16:15:56 dist-test-slave-nj21 krb5kdc[32170](info): commencing operation
krb5kdc: starting...
W20260809 16:15:57.252471 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:15:57 dist-test-slave-nj21 krb5kdc[32170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:15:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:15:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:15:57.363884 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:36031
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:35237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:36031
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:57.443894 32193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:57.444078 32193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:57.444098 32193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:57.445202 32193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:15:57.445243 32193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:57.445256 32193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:57.445279 32193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:15:57.445303 32193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:15:57.446712 32193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:35237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:36031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:36031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:57.446925 32193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:57.447132 32193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:57.451576 32204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:57.451586 32201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:57.451586 32206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:57.451820 32193 server_base.cc:1034] running on GCE node
I20260809 16:15:57.452052 32193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:57.452297 32193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:57.453437 32193 hybrid_clock.cc:648] HybridClock initialized: now 1786292157453424 us; error 31 us; skew 500 ppm
Aug 09 16:15:57 dist-test-slave-nj21 krb5kdc[32170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:57.455722 32193 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:15:57.456118 32193 webserver.cc:460] Webserver started at http://127.27.217.62:36993/ using document root <none> and password file <none>
I20260809 16:15:57.456305 32193 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:57.456350 32193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:57.456472 32193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:57.457427 32193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "c46679bfbd5c453caf981dbbf2ed78d5"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "45a3090208f8f7ef1d2d98dbb529a594"
server_key_iv: "3fae92fe5f88477711c2984760c4da95"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.457744 32193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "c46679bfbd5c453caf981dbbf2ed78d5"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "45a3090208f8f7ef1d2d98dbb529a594"
server_key_iv: "3fae92fe5f88477711c2984760c4da95"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.458950 32193 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:15:57.459545 32217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:57.459728 32193 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:57.459815 32193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "c46679bfbd5c453caf981dbbf2ed78d5"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "45a3090208f8f7ef1d2d98dbb529a594"
server_key_iv: "3fae92fe5f88477711c2984760c4da95"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.459880 32193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:57.503762 32193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:57.505679 32193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:57.505820 32193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:57.509615 32193 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:36031
I20260809 16:15:57.509655 32300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:36031 every 8 connection(s)
I20260809 16:15:57.509984 32193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:15:57.510833 32302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:57.513135 32302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5: Bootstrap starting.
I20260809 16:15:57.513711 32302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:57.513981 32302 log.cc:824] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:57.514611 32302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5: No bootstrap required, opened a new log
I20260809 16:15:57.516185 32302 raft_consensus.cc:348] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46679bfbd5c453caf981dbbf2ed78d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36031 } }
I20260809 16:15:57.516317 32302 raft_consensus.cc:374] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:57.516350 32302 raft_consensus.cc:729] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c46679bfbd5c453caf981dbbf2ed78d5, State: Initialized, Role: FOLLOWER
I20260809 16:15:57.516491 32302 consensus_queue.cc:260] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46679bfbd5c453caf981dbbf2ed78d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36031 } }
I20260809 16:15:57.516551 32302 raft_consensus.cc:388] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:15:57.516573 32302 raft_consensus.cc:482] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:15:57.516618 32302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:57.517094 32302 raft_consensus.cc:504] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46679bfbd5c453caf981dbbf2ed78d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36031 } }
I20260809 16:15:57.517184 32302 leader_election.cc:302] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c46679bfbd5c453caf981dbbf2ed78d5; no voters:
I20260809 16:15:57.517343 32302 leader_election.cc:288] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:15:57.517383 32306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:57.517572 32302 sys_catalog.cc:564] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:15:57.517748 32306 raft_consensus.cc:686] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [term 1 LEADER]: Becoming Leader. State: Replica: c46679bfbd5c453caf981dbbf2ed78d5, State: Running, Role: LEADER
I20260809 16:15:57.517867 32306 consensus_queue.cc:237] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46679bfbd5c453caf981dbbf2ed78d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36031 } }
I20260809 16:15:57.518218 32307 sys_catalog.cc:455] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c46679bfbd5c453caf981dbbf2ed78d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46679bfbd5c453caf981dbbf2ed78d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36031 } } }
I20260809 16:15:57.518229 32310 sys_catalog.cc:455] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c46679bfbd5c453caf981dbbf2ed78d5. Latest consensus state: current_term: 1 leader_uuid: "c46679bfbd5c453caf981dbbf2ed78d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46679bfbd5c453caf981dbbf2ed78d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36031 } } }
I20260809 16:15:57.518321 32307 sys_catalog.cc:458] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:57.518325 32310 sys_catalog.cc:458] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5 [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:57.518517 32322 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:15:57.518661 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 32193
I20260809 16:15:57.518754 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:15:57.518921 28516 external_mini_cluster.cc:1428] Setting key 6f89232822d2ddc53707b2f19f038fbe
I20260809 16:15:57.519033 32322 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 16:15:57 dist-test-slave-nj21 krb5kdc[32170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:57.526016 32322 catalog_manager.cc:1347] Generated new cluster ID: 6a519fab6806473f8fd94d6512fc5c3a
I20260809 16:15:57.526072 32322 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:15:57.528558 32335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:57.519498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45770 (local address 127.27.217.62:36031)
0809 16:15:57.520178 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:57.520186 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:57.520217 (+ 31us) server_negotiation.cc:407] Connection header received
0809 16:15:57.520308 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:57.520313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:57.520354 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:57.520474 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:57.521093 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.522013 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.522714 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.523126 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.523218 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:57.525653 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:57.525656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:57.525656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:57.525666 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:57.527156 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:57.527473 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:57.527476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:57.527476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:57.527556 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:57.527752 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:57.527752 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:57.527753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:57.527975 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:57.528118 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:57.528225 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 16:15:57.528355 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":90,"threads_started":1}
I20260809 16:15:57.534134 32322 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:15:57.534761 32322 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:15:57.536859 32322 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c46679bfbd5c453caf981dbbf2ed78d5: Generated new TSK 0
I20260809 16:15:57.537012 32322 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:15:57.567723 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36031
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:35237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:57.681771 32340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:57.682040 32340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:57.682075 32340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:57.683377 32340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:57.683429 32340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:57.683465 32340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:15:57.685415 32340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:35237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:57.685791 32340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:57.686081 32340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:57.692023 32351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:57.692075 32345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:57.692025 32347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:57.693514 32340 server_base.cc:1034] running on GCE node
I20260809 16:15:57.693722 32340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:57.693961 32340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:57.695118 32340 hybrid_clock.cc:648] HybridClock initialized: now 1786292157695095 us; error 34 us; skew 500 ppm
Aug 09 16:15:57 dist-test-slave-nj21 krb5kdc[32170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:57.697515 32340 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:15:57.697901 32340 webserver.cc:460] Webserver started at http://127.27.217.1:41863/ using document root <none> and password file <none>
I20260809 16:15:57.698094 32340 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:57.698134 32340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:57.698225 32340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:57.699210 32340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "5d022662fb354defa1a1c75f8e53075e"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "da77b98c94f510d823c8c8eb7a09040f"
server_key_iv: "67a23a2da155e8b8c460d3afebd1dcd8"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.699504 32340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "5d022662fb354defa1a1c75f8e53075e"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "da77b98c94f510d823c8c8eb7a09040f"
server_key_iv: "67a23a2da155e8b8c460d3afebd1dcd8"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.700778 32340 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:15:57.701465 32360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:57.701603 32340 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:15:57.701687 32340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "5d022662fb354defa1a1c75f8e53075e"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "da77b98c94f510d823c8c8eb7a09040f"
server_key_iv: "67a23a2da155e8b8c460d3afebd1dcd8"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.701747 32340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:57.721109 32340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:57.722769 32340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:57.722903 32340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:57.723119 32340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:57.723402 32340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:57.723436 32340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:57.723465 32340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:57.723488 32340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:57.728987 32340 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:45901
I20260809 16:15:57.729045 32537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:45901 every 8 connection(s)
I20260809 16:15:57.729337 32340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:15:57.733522 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 32340
I20260809 16:15:57.733601 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:15:57.733781 28516 external_mini_cluster.cc:1428] Setting key f05d93a6bedf3af209e2e2c150232e25
Aug 09 16:15:57 dist-test-slave-nj21 krb5kdc[32170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:57.739012 32335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:57.730043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:55773 (local address 127.27.217.62:36031)
0809 16:15:57.730108 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:57.730110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:57.730291 (+ 181us) server_negotiation.cc:407] Connection header received
0809 16:15:57.730813 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:57.730814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:57.730831 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:57.730882 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:57.731908 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.732420 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.733390 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.733615 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.733676 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:57.736047 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:57.736049 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:57.736049 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:57.736060 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:57.737430 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:57.737875 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:57.737876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:57.737876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:57.737950 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:57.738216 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:57.738217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:57.738218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:57.738349 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:57.738421 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:57.738793 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 16:15:57.738892 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 16:15:57.739110 32541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:57.729998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:36031 (local address 127.27.217.1:55773)
0809 16:15:57.730174 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:57.730209 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:57.730710 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:57.730956 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:57.730959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:57.731546 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:57.731820 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:57.731825 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.732505 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.732506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:57.733289 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:57.733291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.733683 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.733684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:57.733812 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:57.734345 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:57.734354 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:57.735961 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:57.737520 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:57.737526 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:57.737528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:57.737787 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:57.738014 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:57.738015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:57.738015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:57.738160 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:57.738417 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:57.738422 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:57.738632 (+ 210us) client_negotiation.cc:769] Sending connection context
0809 16:15:57.738751 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 16:15:57.738932 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":83,"threads_started":1}
I20260809 16:15:57.739660 32538 heartbeater.cc:347] Connected to a master server at 127.27.217.62:36031
I20260809 16:15:57.739802 32538 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:57.739974 32538 heartbeater.cc:511] Master 127.27.217.62:36031 requested a full tablet report, sending...
I20260809 16:15:57.740561 32245 ts_manager.cc:194] Registered new tserver with Master: 5d022662fb354defa1a1c75f8e53075e (127.27.217.1:45901)
I20260809 16:15:57.741499 32245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:55773
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:15:57.760311 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36031
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:35237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:57.840274 32547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:57.840482 32547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:57.840514 32547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:57.841636 32547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:57.841675 32547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:57.841708 32547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:15:57.843067 32547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:35237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:57.843299 32547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:57.843509 32547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:57.848176 32559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:57.848261 32562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:57.848398 32547 server_base.cc:1034] running on GCE node
W20260809 16:15:57.848529 32555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:57.848765 32547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:57.849048 32547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:57.850219 32547 hybrid_clock.cc:648] HybridClock initialized: now 1786292157850189 us; error 41 us; skew 500 ppm
Aug 09 16:15:57 dist-test-slave-nj21 krb5kdc[32170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:57.853098 32547 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:15:57.853583 32547 webserver.cc:460] Webserver started at http://127.27.217.2:39081/ using document root <none> and password file <none>
I20260809 16:15:57.853766 32547 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:57.853806 32547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:57.853894 32547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:57.854852 32547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "3c929c9174e64b47a7c0b41478526ed8"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "6af35ca7f08dc57f585ffe2dd0e0c9aa"
server_key_iv: "9a130914edad716b1dd89f1e3bfc4433"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.855154 32547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "3c929c9174e64b47a7c0b41478526ed8"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "6af35ca7f08dc57f585ffe2dd0e0c9aa"
server_key_iv: "9a130914edad716b1dd89f1e3bfc4433"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.856405 32547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:15:57.857065 32572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:57.857210 32547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:15:57.857291 32547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "3c929c9174e64b47a7c0b41478526ed8"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "6af35ca7f08dc57f585ffe2dd0e0c9aa"
server_key_iv: "9a130914edad716b1dd89f1e3bfc4433"
server_key_version: "encryptionkey@0"
I20260809 16:15:57.857354 32547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:57.871301 32547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:57.873255 32547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:57.873381 32547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:57.873593 32547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:57.873871 32547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:57.873903 32547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:57.873942 32547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:57.873966 32547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:57.879361 32547 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:35793
I20260809 16:15:57.879441 32749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:35793 every 8 connection(s)
I20260809 16:15:57.879719 32547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:15:57.885040 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 32547
I20260809 16:15:57.885142 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:15:57.885347 28516 external_mini_cluster.cc:1428] Setting key 40d9768ddaa7ef557275d407facae380
Aug 09 16:15:57 dist-test-slave-nj21 krb5kdc[32170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:57.889150 32335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:57.880469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:44927 (local address 127.27.217.62:36031)
0809 16:15:57.880564 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:57.880567 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:57.880690 (+ 123us) server_negotiation.cc:407] Connection header received
0809 16:15:57.881240 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:57.881242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:57.881256 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:57.881311 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:57.882304 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.882825 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.883872 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.884072 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.884128 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:57.886443 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:57.886444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:57.886445 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:57.886453 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:57.887831 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:57.888300 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:57.888301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:57.888301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:57.888351 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:57.888587 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:57.888587 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:57.888588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:57.888681 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:57.888726 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:57.889020 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 16:15:57.889085 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 16:15:57.889384 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:57.880364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:36031 (local address 127.27.217.2:44927)
0809 16:15:57.880546 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:57.880591 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:57.881120 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:57.881394 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:57.881398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:57.882001 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:57.882194 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:57.882199 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.882915 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.882916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:57.883779 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:57.883782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:57.884153 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:57.884155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:57.884279 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:57.884746 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:57.884755 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:57.886357 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:57.887918 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:57.887927 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:57.887929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:57.888234 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:57.888403 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:57.888403 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:57.888404 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:57.888534 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:57.888731 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:57.888736 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:57.888895 (+ 159us) client_negotiation.cc:769] Sending connection context
0809 16:15:57.889009 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 16:15:57.889166 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
I20260809 16:15:57.889926 32751 heartbeater.cc:347] Connected to a master server at 127.27.217.62:36031
I20260809 16:15:57.890020 32751 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:57.890188 32751 heartbeater.cc:511] Master 127.27.217.62:36031 requested a full tablet report, sending...
I20260809 16:15:57.890549 32245 ts_manager.cc:194] Registered new tserver with Master: 3c929c9174e64b47a7c0b41478526ed8 (127.27.217.2:35793)
I20260809 16:15:57.890913 32245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:44927
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:15:57.909916 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36031
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:35237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:57.989063 32761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:57.989260 32761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:57.989282 32761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:57.990422 32761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:57.990463 32761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:57.990492 32761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:15:57.991935 32761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:35237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:57.992141 32761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:57.992339 32761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:57.996951 32766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:57.996961 32767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:57.996968 301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:57.997179 32761 server_base.cc:1034] running on GCE node
I20260809 16:15:57.997386 32761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:57.997615 32761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:57.998749 32761 hybrid_clock.cc:648] HybridClock initialized: now 1786292157998739 us; error 27 us; skew 500 ppm
Aug 09 16:15:57 dist-test-slave-nj21 krb5kdc[32170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:58.001147 32761 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:15:58.001569 32761 webserver.cc:460] Webserver started at http://127.27.217.3:39899/ using document root <none> and password file <none>
I20260809 16:15:58.001766 32761 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:58.001812 32761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:58.001938 32761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:58.002960 32761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "fef6e3b74e09447f801c92995473346e"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "119592228db02af0973bd7dcd1d80b14"
server_key_iv: "167c6bd19d9eb5c4013dfef8cc7d9fb4"
server_key_version: "encryptionkey@0"
I20260809 16:15:58.003295 32761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "fef6e3b74e09447f801c92995473346e"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "119592228db02af0973bd7dcd1d80b14"
server_key_iv: "167c6bd19d9eb5c4013dfef8cc7d9fb4"
server_key_version: "encryptionkey@0"
I20260809 16:15:58.004667 32761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:15:58.005336 314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:58.005496 32761 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:15:58.005584 32761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "fef6e3b74e09447f801c92995473346e"
format_stamp: "Formatted at 2026-08-09 16:15:57 on dist-test-slave-nj21"
server_key: "119592228db02af0973bd7dcd1d80b14"
server_key_iv: "167c6bd19d9eb5c4013dfef8cc7d9fb4"
server_key_version: "encryptionkey@0"
I20260809 16:15:58.005643 32761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:58.025686 32761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:58.027273 32761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:58.027405 32761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:58.027633 32761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:15:58.027980 32761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:15:58.028015 32761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:58.028045 32761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:15:58.028062 32761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:58.033552 32761 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:41525
I20260809 16:15:58.033591 514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:41525 every 8 connection(s)
I20260809 16:15:58.033879 32761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:15:58.034248 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 32761
I20260809 16:15:58.034340 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:15:58.034551 28516 external_mini_cluster.cc:1428] Setting key 3bbfb808a79a00dabd11fdf6fbf2213e
Aug 09 16:15:58 dist-test-slave-nj21 krb5kdc[32170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292157, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:58.042589 32335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:58.034554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:53257 (local address 127.27.217.62:36031)
0809 16:15:58.034597 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:58.034599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:58.034823 (+ 224us) server_negotiation.cc:407] Connection header received
0809 16:15:58.035430 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:58.035431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:58.035442 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:58.035476 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:58.036431 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:58.037052 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:58.038017 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:58.038287 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:58.038347 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:58.040304 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:58.040305 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:58.040305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:58.040312 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:58.041541 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:58.041880 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:58.041881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:58.041882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:58.041932 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:58.042115 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:58.042115 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:58.042116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:58.042212 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:58.042260 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:58.042463 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 16:15:58.042525 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 16:15:58.042747 521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:58.034550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:36031 (local address 127.27.217.3:53257)
0809 16:15:58.034702 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 16:15:58.034748 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 16:15:58.035327 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:15:58.035548 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:15:58.035551 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:15:58.036148 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:15:58.036336 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:58.036341 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:58.037141 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:58.037142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:58.037938 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:15:58.037940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:15:58.038352 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:15:58.038353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:15:58.038487 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:58.038879 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:15:58.038887 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:15:58.040223 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:15:58.041607 (+ 1384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:58.041612 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:58.041614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:58.041823 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:58.041977 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:15:58.041977 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:15:58.041977 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:15:58.042063 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:15:58.042257 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:15:58.042260 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:15:58.042367 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 16:15:58.042443 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 16:15:58.042556 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260809 16:15:58.043190 515 heartbeater.cc:347] Connected to a master server at 127.27.217.62:36031
I20260809 16:15:58.043270 515 heartbeater.cc:464] Registering TS with master...
I20260809 16:15:58.043411 515 heartbeater.cc:511] Master 127.27.217.62:36031 requested a full tablet report, sending...
I20260809 16:15:58.043756 32245 ts_manager.cc:194] Registered new tserver with Master: fef6e3b74e09447f801c92995473346e (127.27.217.3:41525)
I20260809 16:15:58.044109 32245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:53257
I20260809 16:15:58.045981 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 16:15:58.057379 32335 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:15:58.056559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45782 (local address 127.27.217.62:36031)
0809 16:15:58.056609 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:58.056611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:58.056722 (+ 111us) server_negotiation.cc:407] Connection header received
0809 16:15:58.056766 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:58.056767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:58.056775 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:58.056827 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:58.057311 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45782: BlockingRecv error: recv got EOF from 127.0.0.1:45782 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:15:58.058234 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 32340
I20260809 16:15:58.078352 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 32547
I20260809 16:15:58.086980 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 32761
I20260809 16:15:58.096202 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 32193
2026-08-09T16:15:58Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1982 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:15:58 dist-test-slave-nj21 krb5kdc[535](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:15:58 dist-test-slave-nj21 krb5kdc[535](info): set up 2 sockets
Aug 09 16:15:58 dist-test-slave-nj21 krb5kdc[535](info): commencing operation
krb5kdc: starting...
W20260809 16:15:59.247649 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:15:59 dist-test-slave-nj21 krb5kdc[535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:15:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:15:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:15:59.360232 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:40493
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:41855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:40493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:15:59.439740 559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:15:59.439935 559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:15:59.439955 559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:15:59.441146 559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:15:59.441190 559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:15:59.441202 559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:15:59.441213 559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:15:59.441226 559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:15:59.442698 559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:41855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:40493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:40493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:15:59.442934 559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:15:59.443135 559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:15:59.447743 575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:59.447763 559 server_base.cc:1034] running on GCE node
W20260809 16:15:59.447664 566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:15:59.447732 569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:15:59.448205 559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:15:59.448487 559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:15:59.449625 559 hybrid_clock.cc:648] HybridClock initialized: now 1786292159449611 us; error 27 us; skew 500 ppm
Aug 09 16:15:59 dist-test-slave-nj21 krb5kdc[535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292159, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:15:59.456053 559 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:15:59.456446 559 webserver.cc:460] Webserver started at http://127.27.217.62:42053/ using document root <none> and password file <none>
I20260809 16:15:59.456652 559 fs_manager.cc:359] Metadata directory not provided
I20260809 16:15:59.456698 559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:15:59.456822 559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:15:59.457800 559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "a0e8c5fea37d4555a928880649909107"
format_stamp: "Formatted at 2026-08-09 16:15:59 on dist-test-slave-nj21"
server_key: "ce224e924727ff106f4ec8e116d11b5c"
server_key_iv: "a76b042324f8001c3de3a54e032cd31e"
server_key_version: "encryptionkey@0"
I20260809 16:15:59.458120 559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "a0e8c5fea37d4555a928880649909107"
format_stamp: "Formatted at 2026-08-09 16:15:59 on dist-test-slave-nj21"
server_key: "ce224e924727ff106f4ec8e116d11b5c"
server_key_iv: "a76b042324f8001c3de3a54e032cd31e"
server_key_version: "encryptionkey@0"
I20260809 16:15:59.459306 559 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:15:59.459985 584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:59.460126 559 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:15:59.460209 559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "a0e8c5fea37d4555a928880649909107"
format_stamp: "Formatted at 2026-08-09 16:15:59 on dist-test-slave-nj21"
server_key: "ce224e924727ff106f4ec8e116d11b5c"
server_key_iv: "a76b042324f8001c3de3a54e032cd31e"
server_key_version: "encryptionkey@0"
I20260809 16:15:59.460268 559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:15:59.485308 559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:15:59.486989 559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:15:59.487129 559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:15:59.490989 559 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:40493
I20260809 16:15:59.491029 659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:40493 every 8 connection(s)
I20260809 16:15:59.491555 559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:15:59.492224 660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:15:59.494441 660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107: Bootstrap starting.
I20260809 16:15:59.495007 660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107: Neither blocks nor log segments found. Creating new log.
I20260809 16:15:59.495039 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 559
I20260809 16:15:59.495126 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:15:59.495280 28516 external_mini_cluster.cc:1428] Setting key e40864b86d0dd53a4564e2cb3cfb3176
I20260809 16:15:59.495285 660 log.cc:824] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107: Log is configured to *not* fsync() on all Append() calls
I20260809 16:15:59.496023 660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107: No bootstrap required, opened a new log
I20260809 16:15:59.498013 660 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e8c5fea37d4555a928880649909107" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40493 } }
I20260809 16:15:59.498142 660 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:15:59.498173 660 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e8c5fea37d4555a928880649909107, State: Initialized, Role: FOLLOWER
I20260809 16:15:59.498296 660 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e8c5fea37d4555a928880649909107" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40493 } }
I20260809 16:15:59.498368 660 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:15:59.498399 660 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:15:59.498445 660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:15:59.498947 660 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e8c5fea37d4555a928880649909107" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40493 } }
I20260809 16:15:59.499045 660 leader_election.cc:302] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0e8c5fea37d4555a928880649909107; no voters:
I20260809 16:15:59.499197 660 leader_election.cc:288] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:15:59.499235 666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:15:59.499349 666 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [term 1 LEADER]: Becoming Leader. State: Replica: a0e8c5fea37d4555a928880649909107, State: Running, Role: LEADER
I20260809 16:15:59.499439 660 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:15:59.499508 666 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e8c5fea37d4555a928880649909107" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40493 } }
I20260809 16:15:59.499946 667 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0e8c5fea37d4555a928880649909107. Latest consensus state: current_term: 1 leader_uuid: "a0e8c5fea37d4555a928880649909107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e8c5fea37d4555a928880649909107" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40493 } } }
I20260809 16:15:59.500043 667 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [sys.catalog]: This master's current role is: LEADER
I20260809 16:15:59.500260 677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:15:59.500859 677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:15:59.500279 668 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0e8c5fea37d4555a928880649909107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e8c5fea37d4555a928880649909107" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40493 } } }
I20260809 16:15:59.501564 668 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107 [sys.catalog]: This master's current role is: LEADER
Aug 09 16:15:59 dist-test-slave-nj21 krb5kdc[535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:15:59.503038 677 catalog_manager.cc:1347] Generated new cluster ID: 7a43958e6f5c4ded9be771c3e1476759
I20260809 16:15:59.503087 677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:15:59.505199 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:59.495762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56498 (local address 127.27.217.62:40493)
0809 16:15:59.495955 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:59.495963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:59.495988 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:15:59.496417 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:59.496426 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:59.496482 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:59.496602 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:59.497220 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:59.498079 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:59.498893 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:59.499392 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:59.499504 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:59.502138 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:59.502142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:59.502142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:15:59.502154 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:59.503845 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:59.504167 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:59.504170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:59.504170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:59.504254 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:15:59.504430 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:15:59.504431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:15:59.504432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:15:59.504657 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:59.504807 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:59.504898 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 16:15:59.505039 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
I20260809 16:15:59.506388 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:15:59.514991 677 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:15:59.515507 677 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:15:59.522949 677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0e8c5fea37d4555a928880649909107: Generated new TSK 0
I20260809 16:15:59.523116 677 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:15:59.525318 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:15:59.521338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56506 (local address 127.27.217.62:40493)
0809 16:15:59.521376 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 16:15:59.521378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:15:59.521547 (+ 169us) server_negotiation.cc:407] Connection header received
0809 16:15:59.521595 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:15:59.521596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:15:59.521607 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:15:59.521655 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:15:59.522061 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:59.523034 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:59.524119 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:15:59.524316 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:15:59.524368 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:15:59.524958 (+ 590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:15:59.524959 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:15:59.524960 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:15:59.525116 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:15:59.525131 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:15:59.525137 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:15:59.525179 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 16:15:59.525246 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 16:15:59.525268 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:15:59.527765 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 559
2026-08-09T16:15:59Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1440 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:15:59 dist-test-slave-nj21 krb5kdc[714](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:15:59 dist-test-slave-nj21 krb5kdc[714](info): set up 2 sockets
Aug 09 16:15:59 dist-test-slave-nj21 krb5kdc[714](info): commencing operation
krb5kdc: starting...
W20260809 16:16:00.672096 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:00 dist-test-slave-nj21 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:16:00.784072 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:33355
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:45717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:33355
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:00.864534 738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:00.864730 738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:00.864753 738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:00.865875 738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:00.865913 738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:00.865926 738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:00.865950 738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:00.865972 738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:00.867424 738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:45717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:33355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:33355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:00.867645 738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:00.867869 738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:00.872313 746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:00.872318 745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:00.872350 751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:00.872350 738 server_base.cc:1034] running on GCE node
I20260809 16:16:00.872753 738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:00.873044 738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:00.874177 738 hybrid_clock.cc:648] HybridClock initialized: now 1786292160874163 us; error 33 us; skew 500 ppm
Aug 09 16:16:00 dist-test-slave-nj21 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292160, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:00.876536 738 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:16:00.877008 738 webserver.cc:460] Webserver started at http://127.27.217.62:43829/ using document root <none> and password file <none>
I20260809 16:16:00.877242 738 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:00.877305 738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:00.877445 738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:00.878523 738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "a21a688e3ac84dfe9932fb2a7c50ddef"
format_stamp: "Formatted at 2026-08-09 16:16:00 on dist-test-slave-nj21"
server_key: "271f7cbaa5b1383e560b02612f9bacef"
server_key_iv: "f146b2e477460cc8ed8f835d79d07128"
server_key_version: "encryptionkey@0"
I20260809 16:16:00.878811 738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "a21a688e3ac84dfe9932fb2a7c50ddef"
format_stamp: "Formatted at 2026-08-09 16:16:00 on dist-test-slave-nj21"
server_key: "271f7cbaa5b1383e560b02612f9bacef"
server_key_iv: "f146b2e477460cc8ed8f835d79d07128"
server_key_version: "encryptionkey@0"
I20260809 16:16:00.879980 738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:16:00.880609 759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:00.880736 738 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:00.880816 738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "a21a688e3ac84dfe9932fb2a7c50ddef"
format_stamp: "Formatted at 2026-08-09 16:16:00 on dist-test-slave-nj21"
server_key: "271f7cbaa5b1383e560b02612f9bacef"
server_key_iv: "f146b2e477460cc8ed8f835d79d07128"
server_key_version: "encryptionkey@0"
I20260809 16:16:00.880882 738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:00.895895 738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:00.897504 738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:00.897626 738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:00.901337 738 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:33355
I20260809 16:16:00.901381 836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:33355 every 8 connection(s)
I20260809 16:16:00.901666 738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:00.902637 837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:00.904870 837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef: Bootstrap starting.
I20260809 16:16:00.905403 837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:00.905656 837 log.cc:824] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:00.906258 837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef: No bootstrap required, opened a new log
I20260809 16:16:00.907811 837 raft_consensus.cc:348] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21a688e3ac84dfe9932fb2a7c50ddef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33355 } }
I20260809 16:16:00.907941 837 raft_consensus.cc:374] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:00.907975 837 raft_consensus.cc:729] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21a688e3ac84dfe9932fb2a7c50ddef, State: Initialized, Role: FOLLOWER
I20260809 16:16:00.908118 837 consensus_queue.cc:260] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21a688e3ac84dfe9932fb2a7c50ddef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33355 } }
I20260809 16:16:00.908206 837 raft_consensus.cc:388] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:00.908244 837 raft_consensus.cc:482] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:00.908269 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 738
I20260809 16:16:00.908294 837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:00.908373 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:00.908543 28516 external_mini_cluster.cc:1428] Setting key 0d3556908f9b12147c21284b05b186c5
I20260809 16:16:00.909240 837 raft_consensus.cc:504] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21a688e3ac84dfe9932fb2a7c50ddef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33355 } }
I20260809 16:16:00.909339 837 leader_election.cc:302] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a21a688e3ac84dfe9932fb2a7c50ddef; no voters:
I20260809 16:16:00.909530 837 leader_election.cc:288] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:00.909564 850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:00.909725 850 raft_consensus.cc:686] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [term 1 LEADER]: Becoming Leader. State: Replica: a21a688e3ac84dfe9932fb2a7c50ddef, State: Running, Role: LEADER
I20260809 16:16:00.909776 837 sys_catalog.cc:564] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:00.909842 850 consensus_queue.cc:237] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21a688e3ac84dfe9932fb2a7c50ddef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33355 } }
I20260809 16:16:00.910166 850 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [sys.catalog]: SysCatalogTable state changed. Reason: New leader a21a688e3ac84dfe9932fb2a7c50ddef. Latest consensus state: current_term: 1 leader_uuid: "a21a688e3ac84dfe9932fb2a7c50ddef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21a688e3ac84dfe9932fb2a7c50ddef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33355 } } }
I20260809 16:16:00.910277 850 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:00.910504 858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:00.911039 858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:00.910169 852 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a21a688e3ac84dfe9932fb2a7c50ddef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21a688e3ac84dfe9932fb2a7c50ddef" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33355 } } }
I20260809 16:16:00.911741 852 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:00.913079 858 catalog_manager.cc:1347] Generated new cluster ID: a66c99f02b7d4f5d8443fd088317ccf6
I20260809 16:16:00.913132 858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:16:00 dist-test-slave-nj21 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:00.917181 858 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:00.917629 858 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:00.919524 849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:00.909004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59930 (local address 127.27.217.62:33355)
0809 16:16:00.909162 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:00.909171 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:00.909199 (+ 28us) server_negotiation.cc:407] Connection header received
0809 16:16:00.909286 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:00.909291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:00.909332 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:00.909486 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:00.910241 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:00.911522 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:00.912406 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:00.912837 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:00.912957 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:00.915614 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:00.915618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:00.915618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:00.915629 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:00.917537 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:00.917942 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:00.917945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:00.917945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:00.918049 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:00.918252 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:00.918253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:00.918254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:00.918534 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:00.918677 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:00.919166 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 16:16:00.919315 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260809 16:16:00.923552 858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a21a688e3ac84dfe9932fb2a7c50ddef: Generated new TSK 0
I20260809 16:16:00.923722 858 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:16:00.951908 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33355
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:45717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:01.050082 883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:01.050277 883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:01.050298 883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:01.051429 883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:01.051469 883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:01.051494 883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:01.053059 883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:45717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:01.053267 883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:01.053488 883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:01.058097 899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:01.058166 883 server_base.cc:1034] running on GCE node
W20260809 16:16:01.058131 893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:01.058135 895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:01.058507 883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:01.058737 883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:01.059867 883 hybrid_clock.cc:648] HybridClock initialized: now 1786292161059855 us; error 24 us; skew 500 ppm
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292161, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:01.062336 883 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:16:01.062726 883 webserver.cc:460] Webserver started at http://127.27.217.1:38261/ using document root <none> and password file <none>
I20260809 16:16:01.062912 883 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:01.062969 883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:01.063092 883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:01.064127 883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "dde8cec5702349ab969678c8f57f0d4e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "bea3910ee8ec27da983ea7820e32d668"
server_key_iv: "65f5850db640da8476dbfb52df93a48e"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.064447 883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "dde8cec5702349ab969678c8f57f0d4e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "bea3910ee8ec27da983ea7820e32d668"
server_key_iv: "65f5850db640da8476dbfb52df93a48e"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.065618 883 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:01.066241 910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.066403 883 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:01.066489 883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "dde8cec5702349ab969678c8f57f0d4e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "bea3910ee8ec27da983ea7820e32d668"
server_key_iv: "65f5850db640da8476dbfb52df93a48e"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.066548 883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:01.075538 883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:01.077509 883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:01.077629 883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:01.077821 883 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:01.078096 883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:01.078128 883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.078154 883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:01.078179 883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.083559 883 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:39953
I20260809 16:16:01.083598 1091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:39953 every 8 connection(s)
I20260809 16:16:01.083971 883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:01.087112 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 883
I20260809 16:16:01.087211 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:01.087411 28516 external_mini_cluster.cc:1428] Setting key 9489bb24c2c60df0b2148da82418fc42
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292161, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:01.092972 849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:01.084659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:47759 (local address 127.27.217.62:33355)
0809 16:16:01.084721 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:01.084723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:01.084909 (+ 186us) server_negotiation.cc:407] Connection header received
0809 16:16:01.085357 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:01.085358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:01.085367 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:01.085419 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:01.086289 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.086795 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.088082 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.088311 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.088361 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:01.090503 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:01.090504 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:01.090505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:01.090513 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:01.091759 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:01.092108 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:01.092109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:01.092110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:01.092164 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:01.092373 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:01.092374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:01.092374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:01.092486 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:01.092540 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:01.092791 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 16:16:01.092881 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 16:16:01.093137 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:01.084641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33355 (local address 127.27.217.1:47759)
0809 16:16:01.084790 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:01.084829 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:01.085283 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:01.085481 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:01.085484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:01.086038 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:01.086220 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:01.086225 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.086854 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.086855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:01.088017 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:01.088020 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.088387 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.088388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:01.088520 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:01.088979 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:01.088987 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:01.090417 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:01.091820 (+ 1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:01.091828 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:01.091830 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:01.092043 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:01.092216 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:01.092217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:01.092217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:01.092319 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:01.092540 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:01.092546 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:01.092674 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 16:16:01.092763 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 16:16:01.092909 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260809 16:16:01.093550 1092 heartbeater.cc:347] Connected to a master server at 127.27.217.62:33355
I20260809 16:16:01.093655 1092 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:01.093847 1092 heartbeater.cc:511] Master 127.27.217.62:33355 requested a full tablet report, sending...
I20260809 16:16:01.094338 781 ts_manager.cc:194] Registered new tserver with Master: dde8cec5702349ab969678c8f57f0d4e (127.27.217.1:39953)
I20260809 16:16:01.094926 781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:47759
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:16:01.112346 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33355
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:45717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:01.191111 1100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:01.191301 1100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:01.191323 1100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:01.192457 1100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:01.192498 1100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:01.192526 1100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:01.193956 1100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:45717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:01.194170 1100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:01.194386 1100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:01.199115 1109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:01.199105 1112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:01.199088 1107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:01.199293 1100 server_base.cc:1034] running on GCE node
I20260809 16:16:01.199471 1100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:01.199713 1100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:01.200855 1100 hybrid_clock.cc:648] HybridClock initialized: now 1786292161200841 us; error 28 us; skew 500 ppm
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292161, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:01.203202 1100 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:16:01.203595 1100 webserver.cc:460] Webserver started at http://127.27.217.2:42077/ using document root <none> and password file <none>
I20260809 16:16:01.203825 1100 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:01.203876 1100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:01.204008 1100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:01.205000 1100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "2cccb67ee2404b44b7cdd1cf7680d55e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "064093b4960f2db230e02eda8b44cfaa"
server_key_iv: "aea7a7a8fc80dca2e7a2a34b21661823"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.205327 1100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "2cccb67ee2404b44b7cdd1cf7680d55e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "064093b4960f2db230e02eda8b44cfaa"
server_key_iv: "aea7a7a8fc80dca2e7a2a34b21661823"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.206537 1100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:16:01.207180 1123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.207315 1100 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:01.207401 1100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "2cccb67ee2404b44b7cdd1cf7680d55e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "064093b4960f2db230e02eda8b44cfaa"
server_key_iv: "aea7a7a8fc80dca2e7a2a34b21661823"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.207460 1100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:01.219636 1100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:01.221634 1100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:01.221766 1100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:01.221983 1100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:01.222277 1100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:01.222311 1100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.222339 1100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:01.222364 1100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.227837 1100 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:39967
I20260809 16:16:01.227876 1297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:39967 every 8 connection(s)
I20260809 16:16:01.228171 1100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292161, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:01.236409 849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:01.228827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:42197 (local address 127.27.217.62:33355)
0809 16:16:01.228891 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:01.228893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:01.229061 (+ 168us) server_negotiation.cc:407] Connection header received
0809 16:16:01.229541 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:01.229542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:01.229552 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:01.229602 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:01.230447 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.230966 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.231963 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.232166 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.232220 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:01.234146 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:01.234147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:01.234148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:01.234154 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:01.235365 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:01.235682 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:01.235682 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:01.235683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:01.235736 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:01.235943 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:01.235943 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:01.235944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:01.236044 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:01.236088 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:01.236281 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 16:16:01.236344 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 16:16:01.236503 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 1100
I20260809 16:16:01.236596 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:01.236644 1300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:01.228792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33355 (local address 127.27.217.2:42197)
0809 16:16:01.228949 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:01.228984 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:01.229464 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:01.229652 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:01.229655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:01.230190 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:01.230379 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:01.230383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.231029 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.231030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:01.231874 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:01.231877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.232227 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.232228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:01.232318 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:01.232771 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:01.232779 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:01.234065 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:01.235426 (+ 1361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:01.235429 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:01.235430 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:01.235616 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:01.235788 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:01.235789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:01.235789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:01.235886 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:01.236085 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:01.236088 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:01.236191 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 16:16:01.236264 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 16:16:01.236405 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":94,"threads_started":1}
I20260809 16:16:01.236802 28516 external_mini_cluster.cc:1428] Setting key 2c6ab99ebc2507981aca04f0a16ee580
I20260809 16:16:01.237190 1298 heartbeater.cc:347] Connected to a master server at 127.27.217.62:33355
I20260809 16:16:01.237269 1298 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:01.237442 1298 heartbeater.cc:511] Master 127.27.217.62:33355 requested a full tablet report, sending...
I20260809 16:16:01.237818 781 ts_manager.cc:194] Registered new tserver with Master: 2cccb67ee2404b44b7cdd1cf7680d55e (127.27.217.2:39967)
I20260809 16:16:01.238245 781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:42197
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:16:01.260524 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33355
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:45717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:01.339386 1304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:01.339592 1304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:01.339623 1304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:01.340765 1304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:01.340806 1304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:01.340840 1304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:01.342257 1304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:45717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:33355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:01.342497 1304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:01.342698 1304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:01.347365 1313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:01.347374 1314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:01.347433 1318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:01.347661 1304 server_base.cc:1034] running on GCE node
I20260809 16:16:01.347867 1304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:01.348101 1304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:01.349236 1304 hybrid_clock.cc:648] HybridClock initialized: now 1786292161349224 us; error 27 us; skew 500 ppm
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292161, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:01.351639 1304 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:16:01.352056 1304 webserver.cc:460] Webserver started at http://127.27.217.3:33611/ using document root <none> and password file <none>
I20260809 16:16:01.352255 1304 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:01.352295 1304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:01.352385 1304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:01.353348 1304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "196d10c744704413bdaf85bfe8b1039e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "2b4db8f4668d2f5d1386ddac79980940"
server_key_iv: "a935d19e8cbdc9be5212ae15ac90ebd9"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.353641 1304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "196d10c744704413bdaf85bfe8b1039e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "2b4db8f4668d2f5d1386ddac79980940"
server_key_iv: "a935d19e8cbdc9be5212ae15ac90ebd9"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.354912 1304 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:16:01.355537 1331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.355695 1304 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.355778 1304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "196d10c744704413bdaf85bfe8b1039e"
format_stamp: "Formatted at 2026-08-09 16:16:01 on dist-test-slave-nj21"
server_key: "2b4db8f4668d2f5d1386ddac79980940"
server_key_iv: "a935d19e8cbdc9be5212ae15ac90ebd9"
server_key_version: "encryptionkey@0"
I20260809 16:16:01.355829 1304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:01.371109 1304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:01.373119 1304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:01.373227 1304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:01.373400 1304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:01.373653 1304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:01.373682 1304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.373703 1304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:01.373718 1304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:01.379093 1304 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:39225
I20260809 16:16:01.379132 1505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:39225 every 8 connection(s)
I20260809 16:16:01.379420 1304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292161, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:01.385102 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 1304
I20260809 16:16:01.385198 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:01.385402 28516 external_mini_cluster.cc:1428] Setting key 016792de4ca7057739acf78653b2236a
I20260809 16:16:01.388162 849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:01.380118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:60423 (local address 127.27.217.62:33355)
0809 16:16:01.380176 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:01.380178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:01.380359 (+ 181us) server_negotiation.cc:407] Connection header received
0809 16:16:01.380892 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:01.380893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:01.380901 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:01.380945 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:01.381814 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.382299 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.383298 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.383488 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.383538 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:01.385617 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:01.385619 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:01.385619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:01.385627 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:01.386883 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:01.387275 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:01.387276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:01.387276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:01.387337 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:01.387561 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:01.387562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:01.387562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:01.387722 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:01.387823 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:01.388028 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 16:16:01.388099 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:16:01.388312 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:01.380086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33355 (local address 127.27.217.3:60423)
0809 16:16:01.380239 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:01.380280 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:01.380791 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:01.381001 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:01.381004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:01.381551 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:01.381745 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:01.381750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.382362 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.382363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:01.383231 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:01.383234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.383545 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.383546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:01.383637 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:01.384088 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:01.384095 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:01.385515 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:01.386963 (+ 1448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:01.386969 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:01.386971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:01.387179 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:01.387396 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:01.387397 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:01.387397 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:01.387486 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:01.387813 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:01.387817 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:01.387925 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 16:16:01.388012 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 16:16:01.388129 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260809 16:16:01.388801 1506 heartbeater.cc:347] Connected to a master server at 127.27.217.62:33355
I20260809 16:16:01.388908 1506 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:01.389102 1506 heartbeater.cc:511] Master 127.27.217.62:33355 requested a full tablet report, sending...
I20260809 16:16:01.389465 781 ts_manager.cc:194] Registered new tserver with Master: 196d10c744704413bdaf85bfe8b1039e (127.27.217.3:39225)
I20260809 16:16:01.389878 781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:60423
I20260809 16:16:01.396951 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292161, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292161, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:01.418813 849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:01.412684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59934 (local address 127.27.217.62:33355)
0809 16:16:01.412739 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:01.412741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:01.412832 (+ 91us) server_negotiation.cc:407] Connection header received
0809 16:16:01.412887 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:01.412888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:01.412896 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:01.412946 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:01.413458 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.413931 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.414582 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:01.414749 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:01.414789 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:01.416808 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:01.416809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:01.416810 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:01.416816 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:01.418012 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:01.418253 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:01.418253 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:01.418254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:01.418300 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:01.418412 (+ 112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:01.418412 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:01.418413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:01.418549 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:01.418619 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:01.418686 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 16:16:01.418745 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260809 16:16:01.419036 781 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59934
I20260809 16:16:01.419415 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 883
I20260809 16:16:01.428645 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 1100
I20260809 16:16:01.445250 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 1304
I20260809 16:16:01.451018 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 738
2026-08-09T16:16:01Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1920 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[1531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[1531](info): set up 2 sockets
Aug 09 16:16:01 dist-test-slave-nj21 krb5kdc[1531](info): commencing operation
krb5kdc: starting...
W20260809 16:16:02.597232 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:02 dist-test-slave-nj21 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:16:02.711892 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35991
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:35991
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:02.792338 1555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:02.792537 1555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:02.792567 1555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:02.793673 1555 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:02.793723 1555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:02.793743 1555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:02.793759 1555 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:02.793774 1555 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:02.795245 1555 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:35991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:02.795480 1555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:02.795732 1555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:02.800357 1565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:02.800366 1568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:02.800349 1564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:02.800558 1555 server_base.cc:1034] running on GCE node
I20260809 16:16:02.800772 1555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:02.801054 1555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:02.802199 1555 hybrid_clock.cc:648] HybridClock initialized: now 1786292162802184 us; error 29 us; skew 500 ppm
Aug 09 16:16:02 dist-test-slave-nj21 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292162, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:02.804661 1555 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:16:02.805060 1555 webserver.cc:460] Webserver started at http://127.27.217.62:40257/ using document root <none> and password file <none>
I20260809 16:16:02.805256 1555 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:02.805295 1555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:02.805388 1555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:02.806370 1555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "8cec49bc20854873a9ac7da0f667524b"
format_stamp: "Formatted at 2026-08-09 16:16:02 on dist-test-slave-nj21"
server_key: "059c0189e3d3cff66649ab2c9000e895"
server_key_iv: "17a9064d3ab6db0620f05f7736ed6770"
server_key_version: "encryptionkey@0"
I20260809 16:16:02.806655 1555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "8cec49bc20854873a9ac7da0f667524b"
format_stamp: "Formatted at 2026-08-09 16:16:02 on dist-test-slave-nj21"
server_key: "059c0189e3d3cff66649ab2c9000e895"
server_key_iv: "17a9064d3ab6db0620f05f7736ed6770"
server_key_version: "encryptionkey@0"
I20260809 16:16:02.807927 1555 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:16:02.808578 1576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:02.808722 1555 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:02.808807 1555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "8cec49bc20854873a9ac7da0f667524b"
format_stamp: "Formatted at 2026-08-09 16:16:02 on dist-test-slave-nj21"
server_key: "059c0189e3d3cff66649ab2c9000e895"
server_key_iv: "17a9064d3ab6db0620f05f7736ed6770"
server_key_version: "encryptionkey@0"
I20260809 16:16:02.808866 1555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:02.819855 1555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:02.821584 1555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:02.821715 1555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:02.825430 1555 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:35991
I20260809 16:16:02.825474 1663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:35991 every 8 connection(s)
I20260809 16:16:02.825912 1555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:02.826381 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 1555
I20260809 16:16:02.826472 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:02.826625 28516 external_mini_cluster.cc:1428] Setting key 2fb62ba3c9f9e5dc4c638106ba2ac2bf
I20260809 16:16:02.826608 1665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:02.830075 1665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b: Bootstrap starting.
I20260809 16:16:02.830752 1665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:02.831077 1665 log.cc:824] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:02.831785 1665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b: No bootstrap required, opened a new log
Aug 09 16:16:02 dist-test-slave-nj21 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:02.833986 1665 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cec49bc20854873a9ac7da0f667524b" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35991 } }
I20260809 16:16:02.834156 1665 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:02.834203 1665 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cec49bc20854873a9ac7da0f667524b, State: Initialized, Role: FOLLOWER
I20260809 16:16:02.834337 1665 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cec49bc20854873a9ac7da0f667524b" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35991 } }
I20260809 16:16:02.834424 1665 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:02.834461 1665 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:02.834511 1665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:02.835125 1665 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cec49bc20854873a9ac7da0f667524b" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35991 } }
I20260809 16:16:02.835242 1665 leader_election.cc:302] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cec49bc20854873a9ac7da0f667524b; no voters:
I20260809 16:16:02.835398 1665 leader_election.cc:288] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:02.835441 1672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:02.835604 1672 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [term 1 LEADER]: Becoming Leader. State: Replica: 8cec49bc20854873a9ac7da0f667524b, State: Running, Role: LEADER
I20260809 16:16:02.835649 1665 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:02.835803 1672 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cec49bc20854873a9ac7da0f667524b" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35991 } }
I20260809 16:16:02.836232 1673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cec49bc20854873a9ac7da0f667524b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cec49bc20854873a9ac7da0f667524b" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35991 } } }
I20260809 16:16:02.836333 1673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:02.836233 1675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cec49bc20854873a9ac7da0f667524b. Latest consensus state: current_term: 1 leader_uuid: "8cec49bc20854873a9ac7da0f667524b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cec49bc20854873a9ac7da0f667524b" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35991 } } }
I20260809 16:16:02.836689 1675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:02.836892 1687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:02.837489 1687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:02.837899 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:02.827089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40064 (local address 127.27.217.62:35991)
0809 16:16:02.827307 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:02.827317 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:02.827356 (+ 39us) server_negotiation.cc:407] Connection header received
0809 16:16:02.827794 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:02.827803 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:02.827864 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:02.828021 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:02.828574 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:02.829940 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:02.830688 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:02.831290 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:02.831401 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:02.833935 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:02.833940 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:02.833940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:02.833952 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:02.835807 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:02.836263 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:02.836266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:02.836267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:02.836371 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:02.836599 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:02.836600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:02.836600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:02.836906 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:02.837504 (+ 598us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:02.837577 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 16:16:02.837708 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":97,"threads_started":1}
I20260809 16:16:02.838903 1687 catalog_manager.cc:1347] Generated new cluster ID: c6ac9dd101d2408689c283d17a263274
I20260809 16:16:02.838956 1687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:02.844748 1687 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:02.845398 1687 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:02.852480 1687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cec49bc20854873a9ac7da0f667524b: Generated new TSK 0
I20260809 16:16:02.852625 1687 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:16:02.884135 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35991
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:02.963016 1704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:02.963203 1704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:02.963233 1704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:02.964375 1704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:02.964413 1704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:02.964447 1704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:02.965896 1704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:02.966123 1704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:02.966318 1704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:02.970973 1709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:02.970949 1716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:02.970986 1704 server_base.cc:1034] running on GCE node
W20260809 16:16:02.970955 1714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:02.971386 1704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:02.971628 1704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:02.972786 1704 hybrid_clock.cc:648] HybridClock initialized: now 1786292162972772 us; error 33 us; skew 500 ppm
Aug 09 16:16:02 dist-test-slave-nj21 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292162, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:02.975152 1704 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:16:02.975508 1704 webserver.cc:460] Webserver started at http://127.27.217.1:37075/ using document root <none> and password file <none>
I20260809 16:16:02.975732 1704 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:02.975787 1704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:02.975886 1704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:02.976778 1704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "efc4c673d67e4d7b8adba2cec19a4b75"
format_stamp: "Formatted at 2026-08-09 16:16:02 on dist-test-slave-nj21"
server_key: "3bb2f8eadc9e26051062dc849fb1cf66"
server_key_iv: "9a61e71923014e9330049403bf44cbd9"
server_key_version: "encryptionkey@0"
I20260809 16:16:02.977079 1704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "efc4c673d67e4d7b8adba2cec19a4b75"
format_stamp: "Formatted at 2026-08-09 16:16:02 on dist-test-slave-nj21"
server_key: "3bb2f8eadc9e26051062dc849fb1cf66"
server_key_iv: "9a61e71923014e9330049403bf44cbd9"
server_key_version: "encryptionkey@0"
I20260809 16:16:02.978207 1704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:16:02.978842 1723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:02.978994 1704 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:02.979079 1704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "efc4c673d67e4d7b8adba2cec19a4b75"
format_stamp: "Formatted at 2026-08-09 16:16:02 on dist-test-slave-nj21"
server_key: "3bb2f8eadc9e26051062dc849fb1cf66"
server_key_iv: "9a61e71923014e9330049403bf44cbd9"
server_key_version: "encryptionkey@0"
I20260809 16:16:02.979136 1704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:02.998095 1704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:02.999774 1704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:02.999907 1704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:03.000098 1704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:03.000379 1704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:03.000413 1704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:03.000442 1704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:03.000463 1704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:03.005803 1704 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:37419
I20260809 16:16:03.005875 1907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:37419 every 8 connection(s)
I20260809 16:16:03.006153 1704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:03.008865 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 1704
I20260809 16:16:03.008948 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:03.009114 28516 external_mini_cluster.cc:1428] Setting key 1198d2c0f6b40c2f3a48f6aeb59be54c
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292162, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:03.015296 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:03.006785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:40219 (local address 127.27.217.62:35991)
0809 16:16:03.006849 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:03.006851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:03.007031 (+ 180us) server_negotiation.cc:407] Connection header received
0809 16:16:03.007944 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:03.007945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:03.007955 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:03.007995 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:03.008532 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.009091 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.010189 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.010411 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.010467 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:03.012715 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:03.012716 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:03.012717 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:03.012723 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:03.014019 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.014451 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.014451 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.014452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.014496 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.014711 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.014711 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.014712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.014818 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:03.014864 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:03.015158 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 16:16:03.015230 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:16:03.015523 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:03.006757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35991 (local address 127.27.217.1:40219)
0809 16:16:03.006924 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:03.006957 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:03.007849 (+ 892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:03.008048 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:03.008051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:03.008282 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:03.008471 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:03.008475 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.009172 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.009174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:03.010112 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:03.010115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.010481 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.010481 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:03.010606 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:03.011031 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:03.011038 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:03.012616 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:03.014099 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:03.014105 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:03.014107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:03.014384 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:03.014535 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:03.014535 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:03.014536 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:03.014660 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:03.014874 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:03.014879 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:03.015035 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 16:16:03.015149 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 16:16:03.015307 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
I20260809 16:16:03.016003 1908 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35991
I20260809 16:16:03.016086 1908 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:03.016242 1908 heartbeater.cc:511] Master 127.27.217.62:35991 requested a full tablet report, sending...
I20260809 16:16:03.016695 1606 ts_manager.cc:194] Registered new tserver with Master: efc4c673d67e4d7b8adba2cec19a4b75 (127.27.217.1:37419)
I20260809 16:16:03.017252 1606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:40219
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:16:03.033497 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35991
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:03.113381 1914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:03.113571 1914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:03.113592 1914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:03.114698 1914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:03.114740 1914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:03.114764 1914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:03.116250 1914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:03.116472 1914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:03.116695 1914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:03.121369 1924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:03.121341 1923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:03.121353 1927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:03.121589 1914 server_base.cc:1034] running on GCE node
I20260809 16:16:03.121837 1914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:03.122053 1914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:03.123183 1914 hybrid_clock.cc:648] HybridClock initialized: now 1786292163123172 us; error 27 us; skew 500 ppm
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292163, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:03.125579 1914 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:16:03.125955 1914 webserver.cc:460] Webserver started at http://127.27.217.2:35627/ using document root <none> and password file <none>
I20260809 16:16:03.126138 1914 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:03.126176 1914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:03.126263 1914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:03.127211 1914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "d732addd57af40f992b6a10674180feb"
format_stamp: "Formatted at 2026-08-09 16:16:03 on dist-test-slave-nj21"
server_key: "c36ae14e6f5c2dd06d5776fd4e6938da"
server_key_iv: "0604191475eecb2efd24dc88a1b70b46"
server_key_version: "encryptionkey@0"
I20260809 16:16:03.127527 1914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "d732addd57af40f992b6a10674180feb"
format_stamp: "Formatted at 2026-08-09 16:16:03 on dist-test-slave-nj21"
server_key: "c36ae14e6f5c2dd06d5776fd4e6938da"
server_key_iv: "0604191475eecb2efd24dc88a1b70b46"
server_key_version: "encryptionkey@0"
I20260809 16:16:03.128760 1914 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:03.129470 1936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:03.129616 1914 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:03.129698 1914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "d732addd57af40f992b6a10674180feb"
format_stamp: "Formatted at 2026-08-09 16:16:03 on dist-test-slave-nj21"
server_key: "c36ae14e6f5c2dd06d5776fd4e6938da"
server_key_iv: "0604191475eecb2efd24dc88a1b70b46"
server_key_version: "encryptionkey@0"
I20260809 16:16:03.129755 1914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:03.151507 1914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:03.153612 1914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:03.153751 1914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:03.153991 1914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:03.154279 1914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:03.154316 1914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:03.154346 1914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:03.154369 1914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:03.159726 1914 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:34611
I20260809 16:16:03.159777 2132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:34611 every 8 connection(s)
I20260809 16:16:03.160070 1914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292163, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:03.168105 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 1914
I20260809 16:16:03.168205 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:03.168419 28516 external_mini_cluster.cc:1428] Setting key e940cb64457607fa477d5cd7644312f0
I20260809 16:16:03.168902 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:03.160785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45011 (local address 127.27.217.62:35991)
0809 16:16:03.160843 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:03.160845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:03.161057 (+ 212us) server_negotiation.cc:407] Connection header received
0809 16:16:03.161982 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:03.161983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:03.161996 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:03.162048 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:03.162635 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.163137 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.164135 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.164333 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.164388 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:03.166364 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:03.166365 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:03.166366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:03.166372 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:03.167556 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.167956 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.167958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.167958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.168012 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.168223 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.168224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.168225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.168356 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:03.168414 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:03.168760 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 16:16:03.168837 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:16:03.169035 2138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:03.160772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35991 (local address 127.27.217.2:45011)
0809 16:16:03.160946 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:03.160981 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:03.161882 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:03.162118 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:03.162122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:03.162372 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:03.162551 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:03.162556 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.163216 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.163217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:03.164058 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:03.164061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.164398 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.164399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:03.164516 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:03.164916 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:03.164924 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:03.166275 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:03.167633 (+ 1358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:03.167639 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:03.167641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:03.167889 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:03.168068 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:03.168069 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:03.168069 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:03.168170 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:03.168411 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:03.168418 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:03.168562 (+ 144us) client_negotiation.cc:769] Sending connection context
0809 16:16:03.168672 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 16:16:03.168829 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260809 16:16:03.169473 2136 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35991
I20260809 16:16:03.169565 2136 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:03.169737 2136 heartbeater.cc:511] Master 127.27.217.62:35991 requested a full tablet report, sending...
I20260809 16:16:03.170128 1606 ts_manager.cc:194] Registered new tserver with Master: d732addd57af40f992b6a10674180feb (127.27.217.2:34611)
I20260809 16:16:03.170488 1606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:45011
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:16:03.192611 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35991
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:03.272087 2143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:03.272274 2143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:03.272296 2143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:03.273377 2143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:03.273411 2143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:03.273433 2143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:03.274842 2143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:03.275023 2143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:03.275185 2143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:03.279953 2156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:03.279949 2154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:03.279949 2153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:03.280248 2143 server_base.cc:1034] running on GCE node
I20260809 16:16:03.280452 2143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:03.280683 2143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:03.281827 2143 hybrid_clock.cc:648] HybridClock initialized: now 1786292163281816 us; error 25 us; skew 500 ppm
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292163, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:03.284345 2143 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:16:03.284772 2143 webserver.cc:460] Webserver started at http://127.27.217.3:45897/ using document root <none> and password file <none>
I20260809 16:16:03.284965 2143 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:03.285010 2143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:03.285135 2143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:03.286134 2143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "eb46d8eb65d941258a117f1f8f05b19d"
format_stamp: "Formatted at 2026-08-09 16:16:03 on dist-test-slave-nj21"
server_key: "89fca38c86e2117ee218ae915fbd470f"
server_key_iv: "f75ed686b8599a85885a9c2d501f3045"
server_key_version: "encryptionkey@0"
I20260809 16:16:03.286459 2143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "eb46d8eb65d941258a117f1f8f05b19d"
format_stamp: "Formatted at 2026-08-09 16:16:03 on dist-test-slave-nj21"
server_key: "89fca38c86e2117ee218ae915fbd470f"
server_key_iv: "f75ed686b8599a85885a9c2d501f3045"
server_key_version: "encryptionkey@0"
I20260809 16:16:03.287837 2143 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:16:03.288574 2166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:03.288769 2143 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:03.288853 2143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "eb46d8eb65d941258a117f1f8f05b19d"
format_stamp: "Formatted at 2026-08-09 16:16:03 on dist-test-slave-nj21"
server_key: "89fca38c86e2117ee218ae915fbd470f"
server_key_iv: "f75ed686b8599a85885a9c2d501f3045"
server_key_version: "encryptionkey@0"
I20260809 16:16:03.288918 2143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:03.305140 2143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:03.307080 2143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:03.307207 2143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:03.307399 2143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:03.307709 2143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:03.307755 2143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:03.307783 2143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:03.307807 2143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:03.313405 2143 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:40951
I20260809 16:16:03.313463 2341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:40951 every 8 connection(s)
I20260809 16:16:03.313716 2143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:03.317242 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 2143
I20260809 16:16:03.317348 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:03.317518 28516 external_mini_cluster.cc:1428] Setting key a3d689a6acc83b54c83284bb75976d25
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292163, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:03.322686 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:03.314359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:55371 (local address 127.27.217.62:35991)
0809 16:16:03.314402 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:03.314404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:03.314607 (+ 203us) server_negotiation.cc:407] Connection header received
0809 16:16:03.315506 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:03.315508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:03.315520 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:03.315573 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:03.316173 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.316660 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.317638 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.317880 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.317940 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:03.320073 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:03.320074 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:03.320074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:03.320081 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:03.321459 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.321811 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.321812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.321812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.321871 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.322100 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.322100 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.322101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.322231 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:03.322292 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:03.322534 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 16:16:03.322622 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:16:03.322731 2345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:03.314342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35991 (local address 127.27.217.3:55371)
0809 16:16:03.314503 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:03.314534 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:03.315409 (+ 875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:03.315650 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:03.315654 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:03.315915 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:03.316088 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:03.316092 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.316737 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.316738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:03.317567 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:03.317570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.317963 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.317964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:03.318128 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:03.318603 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:03.318610 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:03.319957 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:03.321527 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:03.321532 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:03.321534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:03.321730 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:03.321931 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:03.321931 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:03.321932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:03.322028 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:03.322287 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:03.322291 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:03.322394 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 16:16:03.322471 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 16:16:03.322582 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
I20260809 16:16:03.323171 2343 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35991
I20260809 16:16:03.323256 2343 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:03.323426 2343 heartbeater.cc:511] Master 127.27.217.62:35991 requested a full tablet report, sending...
I20260809 16:16:03.323812 1606 ts_manager.cc:194] Registered new tserver with Master: eb46d8eb65d941258a117f1f8f05b19d (127.27.217.3:40951)
I20260809 16:16:03.324165 1606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:55371
I20260809 16:16:03.329152 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:16:03.351456 2354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:03.344402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54510 (local address 127.27.217.1:37419)
0809 16:16:03.344602 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:03.344607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:03.344617 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:03.344641 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:03.344642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:03.344656 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:03.344731 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:03.345230 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.345979 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.346693 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.347031 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.347087 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:03.349130 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:03.349138 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:03.349138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:03.349145 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:03.350543 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.350843 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.350845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.350846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.350908 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.351036 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.351037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.351037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.351156 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:03.351259 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:03.351308 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 16:16:03.351367 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:03.358466 1670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:03.352709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40078 (local address 127.27.217.62:35991)
0809 16:16:03.352787 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:03.352789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:03.352797 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:03.352818 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:03.352819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:03.352829 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:03.352889 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:03.353326 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.353796 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.354417 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:03.354610 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:03.354661 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:03.356577 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:03.356578 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:03.356578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:03.356585 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:03.357640 (+ 1055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.357914 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.357915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.357915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.357961 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:03.358077 (+ 116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:03.358078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:03.358078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:03.358200 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:03.358270 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:03.358343 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 16:16:03.358403 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 16:16:03.358661 1606 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40078
I20260809 16:16:03.358945 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 1704
I20260809 16:16:03.371873 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 1914
I20260809 16:16:03.389400 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 2143
I20260809 16:16:03.409113 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 1555
2026-08-09T16:16:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1949 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[2363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[2363](info): set up 2 sockets
Aug 09 16:16:03 dist-test-slave-nj21 krb5kdc[2363](info): commencing operation
krb5kdc: starting...
W20260809 16:16:04.547165 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:04 dist-test-slave-nj21 krb5kdc[2363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:16:04.658959 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:36051
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:36051
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:04.737051 2387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:04.737250 2387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:04.737279 2387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:04.738428 2387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:04.738473 2387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:04.738492 2387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:04.738507 2387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:04.738523 2387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:04.740018 2387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:36051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:36051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:04.740262 2387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:04.740466 2387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:04.744943 2396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:04.744957 2395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:04.744982 2387 server_base.cc:1034] running on GCE node
W20260809 16:16:04.744964 2400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:04.745316 2387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:04.745569 2387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:04.746712 2387 hybrid_clock.cc:648] HybridClock initialized: now 1786292164746694 us; error 37 us; skew 500 ppm
Aug 09 16:16:04 dist-test-slave-nj21 krb5kdc[2363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292164, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:04.751739 2387 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:16:04.752022 2387 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:04.752066 2387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:04.752156 2387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:04.753213 2387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "f43e3477c99146acbcd8e167dd6303bf"
format_stamp: "Formatted at 2026-08-09 16:16:04 on dist-test-slave-nj21"
server_key: "dfea57ce1e4a072077a30a929d570a42"
server_key_iv: "63fe4dfefc60e04a89300d35741e2928"
server_key_version: "encryptionkey@0"
I20260809 16:16:04.753578 2387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "f43e3477c99146acbcd8e167dd6303bf"
format_stamp: "Formatted at 2026-08-09 16:16:04 on dist-test-slave-nj21"
server_key: "dfea57ce1e4a072077a30a929d570a42"
server_key_iv: "63fe4dfefc60e04a89300d35741e2928"
server_key_version: "encryptionkey@0"
I20260809 16:16:04.754757 2387 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:04.755474 2414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:04.755657 2387 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:04.755764 2387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "f43e3477c99146acbcd8e167dd6303bf"
format_stamp: "Formatted at 2026-08-09 16:16:04 on dist-test-slave-nj21"
server_key: "dfea57ce1e4a072077a30a929d570a42"
server_key_iv: "63fe4dfefc60e04a89300d35741e2928"
server_key_version: "encryptionkey@0"
I20260809 16:16:04.755821 2387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:04.763713 2387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:04.765220 2387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:04.765327 2387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:04.768884 2387 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:36051
I20260809 16:16:04.768909 2498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:36051 every 8 connection(s)
I20260809 16:16:04.769146 2387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:04.770084 2499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:04.772300 2499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf: Bootstrap starting.
I20260809 16:16:04.772723 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 2387
I20260809 16:16:04.772843 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:04.772890 2499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:04.773011 28516 external_mini_cluster.cc:1428] Setting key f5c07de434602d0a5d8920b8b77d2068
I20260809 16:16:04.773204 2499 log.cc:824] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:04.773872 2499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf: No bootstrap required, opened a new log
I20260809 16:16:04.775564 2499 raft_consensus.cc:348] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e3477c99146acbcd8e167dd6303bf" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36051 } }
I20260809 16:16:04.775708 2499 raft_consensus.cc:374] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:04.775744 2499 raft_consensus.cc:729] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f43e3477c99146acbcd8e167dd6303bf, State: Initialized, Role: FOLLOWER
I20260809 16:16:04.775866 2499 consensus_queue.cc:260] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e3477c99146acbcd8e167dd6303bf" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36051 } }
I20260809 16:16:04.775947 2499 raft_consensus.cc:388] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:04.775983 2499 raft_consensus.cc:482] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:04.776026 2499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:04.776655 2499 raft_consensus.cc:504] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e3477c99146acbcd8e167dd6303bf" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36051 } }
I20260809 16:16:04.776764 2499 leader_election.cc:302] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f43e3477c99146acbcd8e167dd6303bf; no voters:
I20260809 16:16:04.776912 2499 leader_election.cc:288] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:04.776960 2507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:04.777117 2507 raft_consensus.cc:686] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [term 1 LEADER]: Becoming Leader. State: Replica: f43e3477c99146acbcd8e167dd6303bf, State: Running, Role: LEADER
I20260809 16:16:04.777143 2499 sys_catalog.cc:564] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:04.777240 2507 consensus_queue.cc:237] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e3477c99146acbcd8e167dd6303bf" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36051 } }
I20260809 16:16:04.777544 2507 sys_catalog.cc:455] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f43e3477c99146acbcd8e167dd6303bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e3477c99146acbcd8e167dd6303bf" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36051 } } }
I20260809 16:16:04.777628 2507 sys_catalog.cc:458] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:04.777838 2515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:04.777556 2508 sys_catalog.cc:455] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f43e3477c99146acbcd8e167dd6303bf. Latest consensus state: current_term: 1 leader_uuid: "f43e3477c99146acbcd8e167dd6303bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e3477c99146acbcd8e167dd6303bf" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 36051 } } }
I20260809 16:16:04.777967 2508 sys_catalog.cc:458] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:04.778317 2515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 16:16:04 dist-test-slave-nj21 krb5kdc[2363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:04.780114 2515 catalog_manager.cc:1347] Generated new cluster ID: 25242760d91047628b1ca5eeba71140c
I20260809 16:16:04.780169 2515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:04.780536 2533 mvcc.cc:205] Tried to move back new op lower bound from 7316652706936176640 to 7316652706927915008. Current Snapshot: MvccSnapshot[applied={T|T < 7316652706936176640 or (T in {7316652706936176640})}]
I20260809 16:16:04.783880 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:04.773449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.27.217.62:36051)
0809 16:16:04.773619 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:04.773629 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:04.773661 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:16:04.774082 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:04.774089 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:04.774135 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:04.774256 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:04.774860 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:04.775713 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:04.776735 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:04.777326 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:04.777444 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:04.780226 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:04.780229 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:04.780230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:04.780241 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:04.782070 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:04.782421 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:04.782423 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:04.782424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:04.782513 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:04.782677 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:04.782678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:04.782678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:04.782949 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:04.783059 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:04.783532 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 16:16:04.783661 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260809 16:16:04.793802 2515 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:04.794319 2515 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:04.799840 2515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf: Generated new TSK 0
I20260809 16:16:04.799984 2515 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:16:04.834254 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36051
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:04.935633 2539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:04.935899 2539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:04.935923 2539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:04.937019 2539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:04.937058 2539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:04.937085 2539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:04.938505 2539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:04.938689 2539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:04.938884 2539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:16:04.943548 2539 server_base.cc:1034] running on GCE node
W20260809 16:16:04.943514 2547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:04.943502 2549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:04.943516 2546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:04.943930 2539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:04.944164 2539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:04.945302 2539 hybrid_clock.cc:648] HybridClock initialized: now 1786292164945292 us; error 31 us; skew 500 ppm
Aug 09 16:16:04 dist-test-slave-nj21 krb5kdc[2363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292164, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:04.947770 2539 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:16:04.948077 2539 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:04.948128 2539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:04.948251 2539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:04.949222 2539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "60b27e71c15645118e73af2bef502252"
format_stamp: "Formatted at 2026-08-09 16:16:04 on dist-test-slave-nj21"
server_key: "ae7386fe8ee613cb0487b8aee7ad4262"
server_key_iv: "5bd15a42d432b4b181413ff1a4126234"
server_key_version: "encryptionkey@0"
I20260809 16:16:04.949565 2539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "60b27e71c15645118e73af2bef502252"
format_stamp: "Formatted at 2026-08-09 16:16:04 on dist-test-slave-nj21"
server_key: "ae7386fe8ee613cb0487b8aee7ad4262"
server_key_iv: "5bd15a42d432b4b181413ff1a4126234"
server_key_version: "encryptionkey@0"
I20260809 16:16:04.950726 2539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:04.951352 2558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:04.951493 2539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:04.951576 2539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "60b27e71c15645118e73af2bef502252"
format_stamp: "Formatted at 2026-08-09 16:16:04 on dist-test-slave-nj21"
server_key: "ae7386fe8ee613cb0487b8aee7ad4262"
server_key_iv: "5bd15a42d432b4b181413ff1a4126234"
server_key_version: "encryptionkey@0"
I20260809 16:16:04.951637 2539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:04.968473 2539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:04.970446 2539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:04.970577 2539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:04.970782 2539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:04.971063 2539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:04.971096 2539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:04.971124 2539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:04.971141 2539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:04.976475 2539 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:36887
I20260809 16:16:04.976507 2752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:36887 every 8 connection(s)
I20260809 16:16:04.976733 2539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:04.979593 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 2539
I20260809 16:16:04.979744 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:04.979964 28516 external_mini_cluster.cc:1428] Setting key 8459acd4a4cc39e12ead9284cd876848
Aug 09 16:16:04 dist-test-slave-nj21 krb5kdc[2363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292164, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:04.985847 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:04.977423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:34573 (local address 127.27.217.62:36051)
0809 16:16:04.977469 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:04.977471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:04.977656 (+ 185us) server_negotiation.cc:407] Connection header received
0809 16:16:04.978170 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:04.978172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:04.978185 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:04.978235 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:04.979088 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:04.979581 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:04.980901 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:04.981103 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:04.981155 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:04.983320 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:04.983321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:04.983322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:04.983329 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:04.984545 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:04.984987 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:04.984988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:04.984988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:04.985039 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:04.985289 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:04.985290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:04.985290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:04.985380 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:04.985422 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:04.985719 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 16:16:04.985783 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:04.986095 2756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:04.977389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:36051 (local address 127.27.217.1:34573)
0809 16:16:04.977537 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:04.977569 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:04.978055 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:04.978296 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:04.978299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:04.978534 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:04.979021 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:04.979026 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:04.979711 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:04.979713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:04.980825 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:04.980828 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:04.981184 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:04.981186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:04.981336 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:04.981770 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:04.981779 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:04.983234 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:04.984624 (+ 1390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:04.984632 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:04.984634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:04.984919 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:04.985094 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:04.985094 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:04.985095 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:04.985233 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:04.985433 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:04.985439 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:04.985599 (+ 160us) client_negotiation.cc:769] Sending connection context
0809 16:16:04.985712 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 16:16:04.985873 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260809 16:16:04.986621 2753 heartbeater.cc:347] Connected to a master server at 127.27.217.62:36051
I20260809 16:16:04.986716 2753 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:04.986855 2753 heartbeater.cc:511] Master 127.27.217.62:36051 requested a full tablet report, sending...
I20260809 16:16:04.987416 2440 ts_manager.cc:194] Registered new tserver with Master: 60b27e71c15645118e73af2bef502252 (127.27.217.1:36887)
I20260809 16:16:04.988375 2440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:34573
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:16:05.004580 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36051
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:05.083750 2762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:05.083943 2762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:05.083966 2762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:05.085088 2762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:05.085129 2762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:05.085156 2762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:05.086638 2762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:05.086865 2762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:05.087066 2762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:05.091655 2773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:05.091626 2769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:05.091637 2771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:05.091914 2762 server_base.cc:1034] running on GCE node
I20260809 16:16:05.092088 2762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:05.092299 2762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:05.093432 2762 hybrid_clock.cc:648] HybridClock initialized: now 1786292165093420 us; error 27 us; skew 500 ppm
Aug 09 16:16:05 dist-test-slave-nj21 krb5kdc[2363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292165, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:05.095829 2762 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:16:05.096136 2762 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:05.096185 2762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:05.096306 2762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:05.097288 2762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "06eb6c7f893c382bacc997e5964323b6"
server_key_iv: "c298603deab5d5b2c8baf0139af40d40"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.097613 2762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "06eb6c7f893c382bacc997e5964323b6"
server_key_iv: "c298603deab5d5b2c8baf0139af40d40"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.098863 2762 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:05.099505 2781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:05.099647 2762 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:05.099753 2762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "06eb6c7f893c382bacc997e5964323b6"
server_key_iv: "c298603deab5d5b2c8baf0139af40d40"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.099812 2762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:05.123659 2762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:05.125605 2762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:05.125746 2762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:05.125972 2762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:05.126286 2762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:05.126320 2762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:05.126349 2762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:05.126372 2762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:05.132048 2762 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:38173
I20260809 16:16:05.132082 2962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:38173 every 8 connection(s)
I20260809 16:16:05.132346 2762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:16:05 dist-test-slave-nj21 krb5kdc[2363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292165, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:05.139218 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 2762
I20260809 16:16:05.139328 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:05.139518 28516 external_mini_cluster.cc:1428] Setting key 2cc14655a316120186e3bdcfbc69099c
I20260809 16:16:05.141130 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.133039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:37701 (local address 127.27.217.62:36051)
0809 16:16:05.133099 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.133100 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.133235 (+ 135us) server_negotiation.cc:407] Connection header received
0809 16:16:05.133689 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.133690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.133698 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.133757 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:05.134684 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.135193 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.136181 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.136390 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.136453 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.138396 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:05.138397 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:05.138397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:05.138405 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:05.139764 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:05.140164 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:05.140165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:05.140165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:05.140235 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:05.140512 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:05.140513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:05.140513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:05.140632 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:05.140690 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.140961 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.141041 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:16:05.141289 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.132962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:36051 (local address 127.27.217.2:37701)
0809 16:16:05.133116 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:05.133158 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:05.133614 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:05.133812 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:05.133815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:05.134074 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:05.134569 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.134574 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.135283 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.135283 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.136100 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.136102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.136475 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.136476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.136583 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.136995 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:05.137004 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:05.138296 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:05.139826 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:05.139834 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:05.139836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:05.140074 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:05.140296 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:05.140297 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:05.140298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:05.140444 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:05.140688 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:05.140694 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:05.140829 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 16:16:05.140918 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 16:16:05.141074 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260809 16:16:05.141705 2963 heartbeater.cc:347] Connected to a master server at 127.27.217.62:36051
I20260809 16:16:05.141816 2963 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:05.141971 2963 heartbeater.cc:511] Master 127.27.217.62:36051 requested a full tablet report, sending...
I20260809 16:16:05.142338 2440 ts_manager.cc:194] Registered new tserver with Master: 7b2f93a9b72b49e7b2a20c9fbee75fc7 (127.27.217.2:38173)
I20260809 16:16:05.142802 2440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:37701
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:16:05.163398 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36051
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:05.243093 2970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:05.243299 2970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:05.243321 2970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:05.244807 2970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:05.244853 2970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:05.244879 2970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:05.246369 2970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:36051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:05.246555 2970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:05.246732 2970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:05.251623 2976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:05.251629 2978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:05.251626 2975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:05.251665 2970 server_base.cc:1034] running on GCE node
I20260809 16:16:05.252058 2970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:05.252270 2970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:05.253409 2970 hybrid_clock.cc:648] HybridClock initialized: now 1786292165253392 us; error 29 us; skew 500 ppm
Aug 09 16:16:05 dist-test-slave-nj21 krb5kdc[2363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292165, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:05.256011 2970 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:16:05.256367 2970 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:05.256425 2970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:05.256556 2970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:05.257596 2970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "ef9fd526755440e999b37bdf0e396765"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "b736e671dbbd32f9dc9d7212f82d3df4"
server_key_iv: "a3c2e0d1b0371b77085c9f531aba53c2"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.257947 2970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "ef9fd526755440e999b37bdf0e396765"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "b736e671dbbd32f9dc9d7212f82d3df4"
server_key_iv: "a3c2e0d1b0371b77085c9f531aba53c2"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.259191 2970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:05.259876 2989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:05.260022 2970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:05.260111 2970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "ef9fd526755440e999b37bdf0e396765"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "b736e671dbbd32f9dc9d7212f82d3df4"
server_key_iv: "a3c2e0d1b0371b77085c9f531aba53c2"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.260174 2970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:05.272814 2970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:05.274660 2970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:05.274797 2970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:05.275018 2970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:05.275333 2970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:05.275370 2970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:05.275405 2970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:05.275434 2970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:05.281762 2970 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:43431
I20260809 16:16:05.281819 3168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:43431 every 8 connection(s)
I20260809 16:16:05.282066 2970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:16:05 dist-test-slave-nj21 krb5kdc[2363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292165, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:05.287700 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 2970
I20260809 16:16:05.287791 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:05.287988 28516 external_mini_cluster.cc:1428] Setting key 9d1ccc5bf19718d3f6b75838d20717de
I20260809 16:16:05.290653 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.282708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:50009 (local address 127.27.217.62:36051)
0809 16:16:05.282777 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.282779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.282957 (+ 178us) server_negotiation.cc:407] Connection header received
0809 16:16:05.283421 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.283423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.283433 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.283481 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:05.284449 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.284949 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.285940 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.286112 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.286149 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.288199 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:05.288201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:05.288201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:05.288209 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:05.289459 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:05.289807 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:05.289808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:05.289808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:05.289862 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:05.290069 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:05.290070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:05.290070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:05.290180 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:05.290235 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.290489 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.290565 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 16:16:05.290818 3174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.282677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:36051 (local address 127.27.217.3:50009)
0809 16:16:05.282840 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:05.282874 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:05.283346 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:05.283535 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:05.283539 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:05.283888 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:05.284370 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.284377 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.285026 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.285027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.285871 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.285874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.286161 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.286162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.286255 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.286638 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:05.286646 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:05.288111 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:05.289531 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:05.289537 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:05.289539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:05.289743 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:05.289914 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:05.289914 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:05.289915 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:05.290015 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:05.290232 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:05.290238 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:05.290368 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 16:16:05.290462 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 16:16:05.290611 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260809 16:16:05.291208 3172 heartbeater.cc:347] Connected to a master server at 127.27.217.62:36051
I20260809 16:16:05.291288 3172 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:05.291435 3172 heartbeater.cc:511] Master 127.27.217.62:36051 requested a full tablet report, sending...
I20260809 16:16:05.291800 2440 ts_manager.cc:194] Registered new tserver with Master: ef9fd526755440e999b37bdf0e396765 (127.27.217.3:43431)
I20260809 16:16:05.292136 2440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:50009
I20260809 16:16:05.299518 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:16:05.306129 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.300785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55288 (local address 127.27.217.62:36051)
0809 16:16:05.300820 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.300822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.300928 (+ 106us) server_negotiation.cc:407] Connection header received
0809 16:16:05.300998 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.300999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.301008 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.301050 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:05.301576 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.302036 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.302784 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.302967 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.303020 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.304147 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:05.304148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:05.304148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:05.304155 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:05.305122 (+ 967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:05.305406 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:05.305407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:05.305408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:05.305471 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:05.305628 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:05.305629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:05.305629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:05.305767 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:05.305857 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.305970 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.306045 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:16:05.307379 2440 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55288:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:05.309022 2440 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:05.315062 3191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.311085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:38173 (local address 127.0.0.1:51212)
0809 16:16:05.311422 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:05.311462 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:05.311534 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:05.311987 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:05.311987 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:05.311989 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:05.312043 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.312044 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.313285 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.313286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.314144 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.314146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.314770 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.314771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.314862 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.314875 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 16:16:05.314936 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 16:16:05.314987 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260809 16:16:05.315075 3196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.311251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51212 (local address 127.27.217.2:38173)
0809 16:16:05.311417 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.311431 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.311610 (+ 179us) server_negotiation.cc:407] Connection header received
0809 16:16:05.311649 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.311651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.311664 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.311758 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:05.312121 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.313187 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.314215 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.314689 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.314751 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.314808 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.314958 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.314998 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260809 16:16:05.315181 3194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.311227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44946 (local address 127.27.217.1:36887)
0809 16:16:05.311384 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.311389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.311568 (+ 179us) server_negotiation.cc:407] Connection header received
0809 16:16:05.311640 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.311643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.311659 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.311758 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:05.311970 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.312711 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.313991 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.314686 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.314730 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.314783 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.315009 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.315049 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260809 16:16:05.315382 3193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.311084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:36887 (local address 127.0.0.1:44946)
0809 16:16:05.311488 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:05.311498 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:05.311567 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:05.311797 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:05.311800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:05.311803 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:05.311914 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.311915 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.312798 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.312799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.313884 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.313887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.314839 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.314840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.314906 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.314909 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:05.315271 (+ 362us) client_negotiation.cc:240] Negotiation successful
0809 16:16:05.315314 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":277,"thread_start_us":75,"threads_started":1}
I20260809 16:16:05.315491 3195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.311223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39706 (local address 127.27.217.3:43431)
0809 16:16:05.311502 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.311506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.311627 (+ 121us) server_negotiation.cc:407] Connection header received
0809 16:16:05.311695 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.311697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.311712 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.311970 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:05.312049 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.313140 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.314430 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.315090 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.315145 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.315197 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.315371 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.315415 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":92,"threads_started":1}
I20260809 16:16:05.315475 3197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.311088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:43431 (local address 127.0.0.1:39706)
0809 16:16:05.311512 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:05.311523 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:05.311567 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:05.311851 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:05.311852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:05.311854 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:05.311912 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.311914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.313258 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.313259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.314335 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.314338 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.315232 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.315233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.315298 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.315301 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:05.315354 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:16:05.315385 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":26,"spinlock_wait_cycles":1280,"thread_start_us":46,"threads_started":1}
I20260809 16:16:05.316169 2863 tablet_service.cc:1467] Processing CreateTablet for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2 (DEFAULT_TABLE table=test-table [id=f39f786a7cf64dab96c17cd2de3ceea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:05.316390 3073 tablet_service.cc:1467] Processing CreateTablet for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2 (DEFAULT_TABLE table=test-table [id=f39f786a7cf64dab96c17cd2de3ceea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:05.316547 2863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:05.316715 3073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:05.319850 3198 tablet_bootstrap.cc:492] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Bootstrap starting.
I20260809 16:16:05.320047 3199 tablet_bootstrap.cc:492] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Bootstrap starting.
I20260809 16:16:05.320271 2632 tablet_service.cc:1467] Processing CreateTablet for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2 (DEFAULT_TABLE table=test-table [id=f39f786a7cf64dab96c17cd2de3ceea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:05.320550 2632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:05.320598 3198 tablet_bootstrap.cc:654] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:05.320622 3199 tablet_bootstrap.cc:654] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:05.321216 3198 log.cc:824] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:05.321216 3199 log.cc:824] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:05.321947 3199 tablet_bootstrap.cc:492] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: No bootstrap required, opened a new log
I20260809 16:16:05.322018 3199 ts_tablet_manager.cc:1397] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:05.322221 3198 tablet_bootstrap.cc:492] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: No bootstrap required, opened a new log
I20260809 16:16:05.322500 3198 ts_tablet_manager.cc:1397] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 16:16:05.323292 3202 tablet_bootstrap.cc:492] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252: Bootstrap starting.
I20260809 16:16:05.323868 3202 tablet_bootstrap.cc:654] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:05.324023 3199 raft_consensus.cc:348] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.324193 3199 raft_consensus.cc:374] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:05.324258 3199 raft_consensus.cc:729] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2f93a9b72b49e7b2a20c9fbee75fc7, State: Initialized, Role: FOLLOWER
I20260809 16:16:05.324384 3202 log.cc:824] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:05.324383 3199 consensus_queue.cc:260] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.324371 3198 raft_consensus.cc:348] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.324558 3198 raft_consensus.cc:374] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:05.324633 3198 raft_consensus.cc:729] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9fd526755440e999b37bdf0e396765, State: Initialized, Role: FOLLOWER
I20260809 16:16:05.324661 3199 ts_tablet_manager.cc:1428] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 16:16:05.324677 2963 heartbeater.cc:503] Master 127.27.217.62:36051 was elected leader, sending a full tablet report...
I20260809 16:16:05.324779 3198 consensus_queue.cc:260] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.325029 3198 ts_tablet_manager.cc:1428] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:05.325029 3172 heartbeater.cc:503] Master 127.27.217.62:36051 was elected leader, sending a full tablet report...
I20260809 16:16:05.325726 3202 tablet_bootstrap.cc:492] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252: No bootstrap required, opened a new log
I20260809 16:16:05.325948 3202 ts_tablet_manager.cc:1397] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 16:16:05.327239 3202 raft_consensus.cc:348] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.327353 3202 raft_consensus.cc:374] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:05.327373 3202 raft_consensus.cc:729] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60b27e71c15645118e73af2bef502252, State: Initialized, Role: FOLLOWER
I20260809 16:16:05.327450 3202 consensus_queue.cc:260] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.327636 3202 ts_tablet_manager.cc:1428] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:05.327708 2753 heartbeater.cc:503] Master 127.27.217.62:36051 was elected leader, sending a full tablet report...
W20260809 16:16:05.382905 2964 tablet.cc:2369] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:16:05.477440 2755 tablet.cc:2369] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:16:05.532590 3173 tablet.cc:2369] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:05.591272 3203 raft_consensus.cc:482] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:05.591421 3203 raft_consensus.cc:504] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.591888 3203 leader_election.cc:288] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef9fd526755440e999b37bdf0e396765 (127.27.217.3:43431), 60b27e71c15645118e73af2bef502252 (127.27.217.1:36887)
I20260809 16:16:05.594657 3209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.592050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:43431 (local address 127.27.217.2:60977)
0809 16:16:05.592227 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:05.592237 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:05.592292 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:05.592410 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:05.592411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:05.592413 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:05.592481 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.592483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.593058 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.593058 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.593862 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.593864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.594398 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.594399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.594473 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.594477 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:05.594521 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:05.594563 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":35,"thread_start_us":98,"threads_started":1}
I20260809 16:16:05.594691 3195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.592205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:60977 (local address 127.27.217.3:43431)
0809 16:16:05.592249 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.592251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.592286 (+ 35us) server_negotiation.cc:407] Connection header received
0809 16:16:05.592345 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.592346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.592356 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.592404 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:05.592541 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.592993 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.593950 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.594331 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.594392 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.594401 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.594562 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.594632 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:16:05.594808 3194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.592135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:39217 (local address 127.27.217.1:36887)
0809 16:16:05.592184 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.592186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.592194 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:05.592247 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.592248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.592258 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.592308 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:05.592464 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.592959 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.593938 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.594299 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.594376 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.594391 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.594696 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.594742 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 16:16:05.595288 3102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70bd9418ab0f46d5bc5f2001da8e0bc2" candidate_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9fd526755440e999b37bdf0e396765" is_pre_election: true
I20260809 16:16:05.595475 3102 raft_consensus.cc:2454] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b2f93a9b72b49e7b2a20c9fbee75fc7 in term 0.
I20260809 16:16:05.594658 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.592045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:36887 (local address 127.27.217.2:39217)
0809 16:16:05.592098 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:05.592112 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:05.592168 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:05.592327 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:05.592328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:05.592330 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:05.592404 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.592405 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.593037 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.593038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.593846 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:05.593849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.594370 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.594371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:05.594474 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.594478 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:05.594534 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 16:16:05.594572 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":31}
I20260809 16:16:05.595733 2786 leader_election.cc:302] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b2f93a9b72b49e7b2a20c9fbee75fc7, ef9fd526755440e999b37bdf0e396765; no voters:
I20260809 16:16:05.595947 2670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70bd9418ab0f46d5bc5f2001da8e0bc2" candidate_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60b27e71c15645118e73af2bef502252" is_pre_election: true
I20260809 16:16:05.596036 3203 raft_consensus.cc:2781] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:05.596079 2670 raft_consensus.cc:2454] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b2f93a9b72b49e7b2a20c9fbee75fc7 in term 0.
I20260809 16:16:05.596112 3203 raft_consensus.cc:482] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:05.596148 3203 raft_consensus.cc:3037] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:05.596877 3203 raft_consensus.cc:504] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.596998 3203 leader_election.cc:288] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [CANDIDATE]: Term 1 election: Requested vote from peers ef9fd526755440e999b37bdf0e396765 (127.27.217.3:43431), 60b27e71c15645118e73af2bef502252 (127.27.217.1:36887)
I20260809 16:16:05.597173 3102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70bd9418ab0f46d5bc5f2001da8e0bc2" candidate_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9fd526755440e999b37bdf0e396765"
I20260809 16:16:05.597244 2670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70bd9418ab0f46d5bc5f2001da8e0bc2" candidate_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60b27e71c15645118e73af2bef502252"
I20260809 16:16:05.597268 3102 raft_consensus.cc:3037] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:05.597342 2670 raft_consensus.cc:3037] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:05.598021 3102 raft_consensus.cc:2454] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b2f93a9b72b49e7b2a20c9fbee75fc7 in term 1.
I20260809 16:16:05.598064 2670 raft_consensus.cc:2454] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b2f93a9b72b49e7b2a20c9fbee75fc7 in term 1.
I20260809 16:16:05.598183 2786 leader_election.cc:302] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b2f93a9b72b49e7b2a20c9fbee75fc7, ef9fd526755440e999b37bdf0e396765; no voters:
I20260809 16:16:05.598263 3203 raft_consensus.cc:2781] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:05.598404 3203 raft_consensus.cc:686] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 1 LEADER]: Becoming Leader. State: Replica: 7b2f93a9b72b49e7b2a20c9fbee75fc7, State: Running, Role: LEADER
I20260809 16:16:05.598491 3203 consensus_queue.cc:237] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } }
I20260809 16:16:05.599316 2439 catalog_manager.cc:5495] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b2f93a9b72b49e7b2a20c9fbee75fc7 (127.27.217.2). New cstate: current_term: 1 leader_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2f93a9b72b49e7b2a20c9fbee75fc7" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260809 16:16:05.665277 3196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.663030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51216 (local address 127.27.217.2:38173)
0809 16:16:05.663101 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.663104 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.663114 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:05.663152 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.663153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.663172 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.663237 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:05.663371 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.663864 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.664589 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:05.664813 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:05.664881 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:05.664989 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:05.665096 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:05.665158 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.665173 (+ 15us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.665191 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 16:16:05.667043 3102 raft_consensus.cc:1261] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 1 FOLLOWER]: Refusing update from remote peer 7b2f93a9b72b49e7b2a20c9fbee75fc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:05.667043 2670 raft_consensus.cc:1261] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 60b27e71c15645118e73af2bef502252 [term 1 FOLLOWER]: Refusing update from remote peer 7b2f93a9b72b49e7b2a20c9fbee75fc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:05.667435 3210 consensus_queue.cc:1035] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60b27e71c15645118e73af2bef502252" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:05.667585 3203 consensus_queue.cc:1035] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9fd526755440e999b37bdf0e396765" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:05.672850 2439 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55288:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:05.672950 2439 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55288:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:05.673717 2439 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f43e3477c99146acbcd8e167dd6303bf: Sending DeleteTablet for 3 replicas of tablet 70bd9418ab0f46d5bc5f2001da8e0bc2
I20260809 16:16:05.674089 3073 tablet_service.cc:1514] Processing DeleteTablet for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:05 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:39706
I20260809 16:16:05.674094 2632 tablet_service.cc:1514] Processing DeleteTablet for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:05 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:44946
I20260809 16:16:05.674396 2863 tablet_service.cc:1514] Processing DeleteTablet for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:05 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:51212
I20260809 16:16:05.674490 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 2539
I20260809 16:16:05.679915 3230 tablet_replica.cc:330] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: stopping tablet replica
I20260809 16:16:05.680080 3230 raft_consensus.cc:2229] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:05.680208 3230 raft_consensus.cc:2258] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:05.680389 3233 tablet_replica.cc:330] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: stopping tablet replica
I20260809 16:16:05.680505 3233 raft_consensus.cc:2229] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:05.680651 3233 raft_consensus.cc:2258] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:05.682668 3233 ts_tablet_manager.cc:1905] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:05.684711 3233 ts_tablet_manager.cc:1918] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:05.684789 3233 log.cc:1196] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/70bd9418ab0f46d5bc5f2001da8e0bc2
I20260809 16:16:05.685060 3233 ts_tablet_manager.cc:1939] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P 7b2f93a9b72b49e7b2a20c9fbee75fc7: Deleting consensus metadata
I20260809 16:16:05.685482 2419 catalog_manager.cc:4841] TS 7b2f93a9b72b49e7b2a20c9fbee75fc7 (127.27.217.2:38173): tablet 70bd9418ab0f46d5bc5f2001da8e0bc2 (table test-table [id=f39f786a7cf64dab96c17cd2de3ceea2]) successfully deleted
I20260809 16:16:05.688072 3230 ts_tablet_manager.cc:1905] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 16:16:05.688742 2416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:36887 (error 108)
I20260809 16:16:05.689323 3197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.689167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:36887 (local address 127.0.0.1:44950)
0809 16:16:05.689234 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:05.689284 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:36887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 16:16:05.689574 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 2762
W20260809 16:16:05.689584 2416 catalog_manager.cc:4584] TS 60b27e71c15645118e73af2bef502252 (127.27.217.1:36887): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 70bd9418ab0f46d5bc5f2001da8e0bc2: Network error: Client connection negotiation failed: client connection to 127.27.217.1:36887: connect: Connection refused (error 111)
I20260809 16:16:05.689714 3230 ts_tablet_manager.cc:1918] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:05.689779 3230 log.cc:1196] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/70bd9418ab0f46d5bc5f2001da8e0bc2
I20260809 16:16:05.690022 3230 ts_tablet_manager.cc:1939] T 70bd9418ab0f46d5bc5f2001da8e0bc2 P ef9fd526755440e999b37bdf0e396765: Deleting consensus metadata
I20260809 16:16:05.690433 2418 catalog_manager.cc:4841] TS ef9fd526755440e999b37bdf0e396765 (127.27.217.3:43431): tablet 70bd9418ab0f46d5bc5f2001da8e0bc2 (table test-table [id=f39f786a7cf64dab96c17cd2de3ceea2]) successfully deleted
I20260809 16:16:05.699808 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 2970
I20260809 16:16:05.711177 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 2387
2026-08-09T16:16:05Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2303 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T16:16:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:05Z Disabled control of system clock
I20260809 16:16:05.742604 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41151
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 16:16:05.822201 3241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:05.822413 3241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:05.822443 3241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:05.823563 3241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:05.823603 3241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:05.823619 3241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:05.823637 3241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:05.823652 3241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:05.825006 3241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41151
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:05.825259 3241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:05.825537 3241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:05.830094 3251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:05.830216 3241 server_base.cc:1034] running on GCE node
W20260809 16:16:05.830082 3248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:05.830096 3247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:05.830518 3241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:05.830786 3241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:05.831931 3241 hybrid_clock.cc:648] HybridClock initialized: now 1786292165831918 us; error 28 us; skew 500 ppm
I20260809 16:16:05.833067 3241 webserver.cc:460] Webserver started at http://127.27.217.62:39367/ using document root <none> and password file <none>
I20260809 16:16:05.833310 3241 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:05.833356 3241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:05.833478 3241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:05.834494 3241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "098c2d8dd19f4cf18ba50db43cdf350c"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "07462bc6c036cc88adbab72e8bdfc20f"
server_key_iv: "977ebfec21ddc3a40821eb47fecc44d9"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.834820 3241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "098c2d8dd19f4cf18ba50db43cdf350c"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "07462bc6c036cc88adbab72e8bdfc20f"
server_key_iv: "977ebfec21ddc3a40821eb47fecc44d9"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.836038 3241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:05.836726 3260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:05.836862 3241 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:05.836941 3241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "098c2d8dd19f4cf18ba50db43cdf350c"
format_stamp: "Formatted at 2026-08-09 16:16:05 on dist-test-slave-nj21"
server_key: "07462bc6c036cc88adbab72e8bdfc20f"
server_key_iv: "977ebfec21ddc3a40821eb47fecc44d9"
server_key_version: "encryptionkey@0"
I20260809 16:16:05.837004 3241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:05.840147 3241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:05.840384 3241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:05.840495 3241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:05.844085 3241 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:41151
I20260809 16:16:05.844121 3354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:41151 every 8 connection(s)
I20260809 16:16:05.844419 3241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:05.845032 3357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:05.846457 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 3241
I20260809 16:16:05.846545 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:05.846709 28516 external_mini_cluster.cc:1428] Setting key 2d6c01ecea1ce6a287909d04a1f5e825
I20260809 16:16:05.848066 3357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c: Bootstrap starting.
I20260809 16:16:05.848723 3357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:05.849042 3357 log.cc:824] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:05.849192 3364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:05.847190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41682 (local address 127.27.217.62:41151)
0809 16:16:05.847377 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:05.847386 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:05.847418 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:16:05.847922 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:05.847931 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:05.847982 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:05.848129 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:05.848722 (+ 593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:05.848726 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:05.848726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:05.848731 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:05.848779 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:05.848793 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:05.848886 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:05.848929 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 16:16:05.848986 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260809 16:16:05.849726 3357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c: No bootstrap required, opened a new log
I20260809 16:16:05.851038 3357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "098c2d8dd19f4cf18ba50db43cdf350c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41151 } }
I20260809 16:16:05.851166 3357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:05.851198 3357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 098c2d8dd19f4cf18ba50db43cdf350c, State: Initialized, Role: FOLLOWER
I20260809 16:16:05.851310 3357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "098c2d8dd19f4cf18ba50db43cdf350c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41151 } }
I20260809 16:16:05.851377 3357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:05.851408 3357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:05.851454 3357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:05.852250 3357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "098c2d8dd19f4cf18ba50db43cdf350c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41151 } }
I20260809 16:16:05.852347 3357 leader_election.cc:302] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 098c2d8dd19f4cf18ba50db43cdf350c; no voters:
I20260809 16:16:05.852488 3357 leader_election.cc:288] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:05.852533 3367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:05.852705 3367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [term 1 LEADER]: Becoming Leader. State: Replica: 098c2d8dd19f4cf18ba50db43cdf350c, State: Running, Role: LEADER
I20260809 16:16:05.852744 3357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:05.852802 3367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "098c2d8dd19f4cf18ba50db43cdf350c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41151 } }
I20260809 16:16:05.853163 3368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "098c2d8dd19f4cf18ba50db43cdf350c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "098c2d8dd19f4cf18ba50db43cdf350c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41151 } } }
I20260809 16:16:05.853245 3368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:05.853458 3372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 098c2d8dd19f4cf18ba50db43cdf350c. Latest consensus state: current_term: 1 leader_uuid: "098c2d8dd19f4cf18ba50db43cdf350c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "098c2d8dd19f4cf18ba50db43cdf350c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41151 } } }
I20260809 16:16:05.853523 3372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c [sys.catalog]: This master's current role is: LEADER
W20260809 16:16:05.854297 3399 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:16:05.854338 3399 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:16:05.854413 3389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:05.854614 3389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:05.855993 3389 catalog_manager.cc:1347] Generated new cluster ID: bef11787f8c54df9a20fce2e37058ae2
I20260809 16:16:05.856048 3389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:05.882629 3389 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:05.882795 3389 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:05.891191 3389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c: Generated new TSK 0
I20260809 16:16:05.891373 3389 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:16:05.898427 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41151
--builtin_ntp_servers=127.27.217.20:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 16:16:05.996886 3405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:05.997074 3405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:05.997095 3405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:05.998201 3405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:05.998239 3405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:05.998263 3405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:05.999548 3405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:05.999786 3405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:06.000046 3405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:06.004714 3411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:06.004760 3405 server_base.cc:1034] running on GCE node
W20260809 16:16:06.004704 3417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:06.004704 3413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:06.005100 3405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:06.005334 3405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:06.006471 3405 hybrid_clock.cc:648] HybridClock initialized: now 1786292166006463 us; error 31 us; skew 500 ppm
I20260809 16:16:06.007591 3405 webserver.cc:460] Webserver started at http://127.27.217.1:39359/ using document root <none> and password file <none>
I20260809 16:16:06.007823 3405 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:06.007874 3405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:06.008014 3405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:06.009039 3405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "50c10e77df1b43e5a59446d5dc7605d9"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "26a677c5095e42320700a5d477cf46cc"
server_key_iv: "0b626cc686eddfe4233d5255ba14b553"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.009364 3405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "50c10e77df1b43e5a59446d5dc7605d9"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "26a677c5095e42320700a5d477cf46cc"
server_key_iv: "0b626cc686eddfe4233d5255ba14b553"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.010715 3405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:06.011353 3428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.011518 3405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:06.011600 3405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "50c10e77df1b43e5a59446d5dc7605d9"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "26a677c5095e42320700a5d477cf46cc"
server_key_iv: "0b626cc686eddfe4233d5255ba14b553"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.011665 3405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:06.015053 3405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:06.015283 3405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:06.015401 3405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:06.015590 3405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:06.015889 3405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:06.015933 3405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.015959 3405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:06.015983 3405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.021298 3405 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:41237
I20260809 16:16:06.021360 3629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:41237 every 8 connection(s)
I20260809 16:16:06.021629 3405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:06.023471 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 3405
I20260809 16:16:06.023566 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:06.023797 28516 external_mini_cluster.cc:1428] Setting key 0c8c5def237468182d2a8ffe5de56ce6
I20260809 16:16:06.024581 3364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.022236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:51815 (local address 127.27.217.62:41151)
0809 16:16:06.022276 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.022278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.022479 (+ 201us) server_negotiation.cc:407] Connection header received
0809 16:16:06.023046 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.023048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.023053 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.023106 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.024354 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.024356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.024356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.024361 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.024378 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.024382 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.024441 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.024514 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.024527 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:16:06.024739 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41151
--builtin_ntp_servers=127.27.217.20:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 16:16:06.024786 3633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.022202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41151 (local address 127.27.217.1:51815)
0809 16:16:06.022368 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.022404 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.022932 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.023154 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.023157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.023165 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:06.024223 (+ 1058us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:06.024224 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:06.024250 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:06.024276 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:06.024447 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:06.024452 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:06.024455 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:06.024526 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:16:06.024587 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":80,"threads_started":1}
I20260809 16:16:06.026473 3631 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41151
I20260809 16:16:06.026572 3631 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:06.026732 3631 heartbeater.cc:511] Master 127.27.217.62:41151 requested a full tablet report, sending...
I20260809 16:16:06.027179 3295 ts_manager.cc:194] Registered new tserver with Master: 50c10e77df1b43e5a59446d5dc7605d9 (127.27.217.1:41237)
W20260809 16:16:06.104614 3634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:06.104816 3634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:06.104846 3634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:06.105963 3634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:06.106000 3634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:06.106032 3634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:06.107327 3634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:06.107542 3634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:06.107851 3634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:06.112465 3647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:06.112483 3652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:06.112501 3642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:06.112519 3634 server_base.cc:1034] running on GCE node
I20260809 16:16:06.112847 3634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:06.113070 3634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:06.114205 3634 hybrid_clock.cc:648] HybridClock initialized: now 1786292166114189 us; error 30 us; skew 500 ppm
I20260809 16:16:06.115422 3634 webserver.cc:460] Webserver started at http://127.27.217.2:33209/ using document root <none> and password file <none>
I20260809 16:16:06.115635 3634 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:06.115707 3634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:06.115845 3634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:06.116873 3634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "975db7e8ff344a4da04f55bea925ab71"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "27bd502d0c08bb9cb50b6ffc9487b9fa"
server_key_iv: "e32b37fa82805b7bf7e0e322185cb62e"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.117203 3634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "975db7e8ff344a4da04f55bea925ab71"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "27bd502d0c08bb9cb50b6ffc9487b9fa"
server_key_iv: "e32b37fa82805b7bf7e0e322185cb62e"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.118350 3634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:06.118965 3664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.119115 3634 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:06.119196 3634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "975db7e8ff344a4da04f55bea925ab71"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "27bd502d0c08bb9cb50b6ffc9487b9fa"
server_key_iv: "e32b37fa82805b7bf7e0e322185cb62e"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.119264 3634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:06.122440 3634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:06.122661 3634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:06.122774 3634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:06.122959 3634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:06.123227 3634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:06.123267 3634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.123292 3634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:06.123317 3634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.128651 3634 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:41495
I20260809 16:16:06.128686 3858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:41495 every 8 connection(s)
I20260809 16:16:06.128964 3634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:16:06.129709 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 3634
I20260809 16:16:06.129832 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:06.130002 28516 external_mini_cluster.cc:1428] Setting key 0d977a07262291b69f2145d6bead93d0
I20260809 16:16:06.130844 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41151
--builtin_ntp_servers=127.27.217.20:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 16:16:06.131918 3364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.129680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:57241 (local address 127.27.217.62:41151)
0809 16:16:06.129752 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.129755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.130017 (+ 262us) server_negotiation.cc:407] Connection header received
0809 16:16:06.130504 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.130506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.130513 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.130565 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.131639 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.131641 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.131641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.131645 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.131661 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.131665 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.131739 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.131832 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.131847 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:16:06.132090 3862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.129673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41151 (local address 127.27.217.2:57241)
0809 16:16:06.129895 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.129934 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.130408 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.130627 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.130631 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.130641 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:06.131502 (+ 861us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:06.131502 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:06.131529 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:06.131556 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:06.131762 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:06.131768 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:06.131771 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:06.131837 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 16:16:06.131896 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260809 16:16:06.132462 3860 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41151
I20260809 16:16:06.132547 3860 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:06.132680 3860 heartbeater.cc:511] Master 127.27.217.62:41151 requested a full tablet report, sending...
I20260809 16:16:06.133013 3295 ts_manager.cc:194] Registered new tserver with Master: 975db7e8ff344a4da04f55bea925ab71 (127.27.217.2:41495)
W20260809 16:16:06.211153 3863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:06.211352 3863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:06.211372 3863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:06.212529 3863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:06.212569 3863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:06.212595 3863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:06.213893 3863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:06.214107 3863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:06.214407 3863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:16:06.219108 3863 server_base.cc:1034] running on GCE node
W20260809 16:16:06.219076 3874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:06.219076 3873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:06.219061 3878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:06.219462 3863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:06.219655 3863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:06.220821 3863 hybrid_clock.cc:648] HybridClock initialized: now 1786292166220810 us; error 27 us; skew 500 ppm
I20260809 16:16:06.222024 3863 webserver.cc:460] Webserver started at http://127.27.217.3:43621/ using document root <none> and password file <none>
I20260809 16:16:06.222234 3863 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:06.222276 3863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:06.222401 3863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:06.223464 3863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "434c0169e2924c42b756c1e3b7d43678"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "dbb0229a148e3b1ef2bc654880a9167a"
server_key_iv: "43aaefcdd1950ccdacf9dc47a6895420"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.223814 3863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "434c0169e2924c42b756c1e3b7d43678"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "dbb0229a148e3b1ef2bc654880a9167a"
server_key_iv: "43aaefcdd1950ccdacf9dc47a6895420"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.225004 3863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:06.225641 3888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.225771 3863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:06.225854 3863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "434c0169e2924c42b756c1e3b7d43678"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "dbb0229a148e3b1ef2bc654880a9167a"
server_key_iv: "43aaefcdd1950ccdacf9dc47a6895420"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.225917 3863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:06.229120 3863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:06.229362 3863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:06.229498 3863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:06.229684 3863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:06.229959 3863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:06.229991 3863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.230015 3863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:06.230041 3863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.235388 3863 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:43539
I20260809 16:16:06.235450 4082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:43539 every 8 connection(s)
I20260809 16:16:06.235777 3863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:06.238381 3364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.236421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:45147 (local address 127.27.217.62:41151)
0809 16:16:06.236497 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.236499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.236684 (+ 185us) server_negotiation.cc:407] Connection header received
0809 16:16:06.237120 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.237121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.237126 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.237175 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.238159 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.238160 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.238160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.238164 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.238195 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.238200 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.238262 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.238315 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.238326 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 16:16:06.238543 4089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.236399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41151 (local address 127.27.217.3:45147)
0809 16:16:06.236574 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.236605 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.237045 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.237227 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.237229 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.237237 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:06.238032 (+ 795us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:06.238032 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:06.238059 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:06.238086 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:06.238262 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:06.238264 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:06.238266 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:16:06.238313 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 16:16:06.238360 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260809 16:16:06.238970 4085 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41151
I20260809 16:16:06.239054 4085 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:06.239192 4085 heartbeater.cc:511] Master 127.27.217.62:41151 requested a full tablet report, sending...
I20260809 16:16:06.239537 3295 ts_manager.cc:194] Registered new tserver with Master: 434c0169e2924c42b756c1e3b7d43678 (127.27.217.3:43539)
I20260809 16:16:06.245927 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 3863
I20260809 16:16:06.246017 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:06.246181 28516 external_mini_cluster.cc:1428] Setting key f19a08b03ea41134d8964f62aa833c50
I20260809 16:16:06.246905 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:16:06.249073 3364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.248207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41690 (local address 127.27.217.62:41151)
0809 16:16:06.248255 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.248256 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.248352 (+ 96us) server_negotiation.cc:407] Connection header received
0809 16:16:06.248419 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.248419 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.248423 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.248460 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.248926 (+ 466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.248926 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.248927 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.248930 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.248943 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.248946 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.248980 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.249016 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.249026 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:16:06.250528 3295 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:06.252075 3295 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:06.255574 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.254091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:41495 (local address 127.0.0.1:46972)
0809 16:16:06.254403 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.254411 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.254449 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.254642 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.254650 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.254657 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:06.255175 (+ 518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:06.255176 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:06.255189 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:06.255207 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:06.255404 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:06.255411 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:06.255414 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:06.255490 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 16:16:06.255504 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":2,"spinlock_wait_cycles":384,"thread_start_us":91,"threads_started":1}
I20260809 16:16:06.255721 4102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.254091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:43539 (local address 127.0.0.1:51326)
0809 16:16:06.254252 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.254292 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.254346 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.254687 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.254688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.254691 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:06.255230 (+ 539us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:06.255230 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:06.255238 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:06.255252 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:06.255564 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:06.255565 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:06.255565 (+ 0us) client_negotiation.cc:769] Sending connection context
0809 16:16:06.255617 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 16:16:06.255630 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":55,"threads_started":1}
I20260809 16:16:06.255589 4105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.254354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46972 (local address 127.27.217.2:41495)
0809 16:16:06.254528 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.254533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.254542 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:06.254563 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.254565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.254572 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.254632 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.255293 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.255299 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.255300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.255304 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.255339 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.255360 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.255402 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.255492 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.255504 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260809 16:16:06.255910 4103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.254160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51326 (local address 127.27.217.3:43539)
0809 16:16:06.254562 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.254568 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.254579 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:16:06.254602 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.254604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.254613 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.254686 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.255448 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.255451 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.255451 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.255455 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.255485 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.255499 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.255555 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.255811 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.255827 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":99,"threads_started":1}
I20260809 16:16:06.256563 3977 tablet_service.cc:1467] Processing CreateTablet for tablet ba814b3f421345fa864b29bd20d2ed0f (DEFAULT_TABLE table=test-table [id=ad900f6c10a2411d8edf96f8653597a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:06.256570 3743 tablet_service.cc:1467] Processing CreateTablet for tablet ba814b3f421345fa864b29bd20d2ed0f (DEFAULT_TABLE table=test-table [id=ad900f6c10a2411d8edf96f8653597a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:06.256928 4104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.254291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:41237 (local address 127.0.0.1:54394)
0809 16:16:06.254545 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.254555 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.254602 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.256056 (+ 1454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.256057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.256059 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:06.256506 (+ 447us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:06.256507 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:06.256515 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:06.256526 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:06.256808 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:06.256809 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:06.256810 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 16:16:06.256848 (+ 38us) client_negotiation.cc:240] Negotiation successful
0809 16:16:06.256861 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":63,"threads_started":1}
I20260809 16:16:06.256949 3977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba814b3f421345fa864b29bd20d2ed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:06.256970 3743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba814b3f421345fa864b29bd20d2ed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:06.257165 4107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.254389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54394 (local address 127.27.217.1:41237)
0809 16:16:06.255647 (+ 1258us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.255651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.255661 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:06.255709 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.255711 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.255720 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.255795 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.256610 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.256619 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.256619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.256624 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.256657 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.256683 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.256744 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.257069 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.257085 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1216,"thread_start_us":68,"threads_started":1}
I20260809 16:16:06.259423 4110 tablet_bootstrap.cc:492] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: Bootstrap starting.
I20260809 16:16:06.259825 4108 tablet_bootstrap.cc:492] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Bootstrap starting.
I20260809 16:16:06.260135 4110 tablet_bootstrap.cc:654] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:06.260249 3514 tablet_service.cc:1467] Processing CreateTablet for tablet ba814b3f421345fa864b29bd20d2ed0f (DEFAULT_TABLE table=test-table [id=ad900f6c10a2411d8edf96f8653597a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:06.260404 4110 log.cc:824] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:06.260461 4108 tablet_bootstrap.cc:654] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:06.260609 3514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba814b3f421345fa864b29bd20d2ed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:06.260764 4108 log.cc:824] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:06.261163 4110 tablet_bootstrap.cc:492] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: No bootstrap required, opened a new log
I20260809 16:16:06.261260 4110 ts_tablet_manager.cc:1397] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:06.261518 4108 tablet_bootstrap.cc:492] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: No bootstrap required, opened a new log
I20260809 16:16:06.261585 4108 ts_tablet_manager.cc:1397] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:06.263213 4110 raft_consensus.cc:348] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.263345 4110 raft_consensus.cc:374] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:06.263376 4110 raft_consensus.cc:729] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434c0169e2924c42b756c1e3b7d43678, State: Initialized, Role: FOLLOWER
I20260809 16:16:06.263509 4110 consensus_queue.cc:260] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.263790 4085 heartbeater.cc:503] Master 127.27.217.62:41151 was elected leader, sending a full tablet report...
I20260809 16:16:06.263789 4110 ts_tablet_manager.cc:1428] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:06.264056 4108 raft_consensus.cc:348] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.264209 4108 raft_consensus.cc:374] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:06.264216 4113 tablet_bootstrap.cc:492] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9: Bootstrap starting.
I20260809 16:16:06.264245 4108 raft_consensus.cc:729] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975db7e8ff344a4da04f55bea925ab71, State: Initialized, Role: FOLLOWER
I20260809 16:16:06.264360 4108 consensus_queue.cc:260] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.264612 4108 ts_tablet_manager.cc:1428] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 16:16:06.264657 3860 heartbeater.cc:503] Master 127.27.217.62:41151 was elected leader, sending a full tablet report...
I20260809 16:16:06.265046 4113 tablet_bootstrap.cc:654] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:06.265369 4113 log.cc:824] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:06.266050 4113 tablet_bootstrap.cc:492] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9: No bootstrap required, opened a new log
I20260809 16:16:06.266103 4113 ts_tablet_manager.cc:1397] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:06.267828 4113 raft_consensus.cc:348] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.267943 4113 raft_consensus.cc:374] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:06.267963 4113 raft_consensus.cc:729] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50c10e77df1b43e5a59446d5dc7605d9, State: Initialized, Role: FOLLOWER
I20260809 16:16:06.268041 4113 consensus_queue.cc:260] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.268260 4113 ts_tablet_manager.cc:1428] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:06.268301 3631 heartbeater.cc:503] Master 127.27.217.62:41151 was elected leader, sending a full tablet report...
W20260809 16:16:06.272078 3632 tablet.cc:2369] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:06.375010 4114 raft_consensus.cc:482] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:06.375138 4114 raft_consensus.cc:504] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.375509 4114 leader_election.cc:288] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 975db7e8ff344a4da04f55bea925ab71 (127.27.217.2:41495), 50c10e77df1b43e5a59446d5dc7605d9 (127.27.217.1:41237)
I20260809 16:16:06.376662 4089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.375695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:41495 (local address 127.27.217.3:43913)
0809 16:16:06.375758 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.375768 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.375808 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.375953 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.375954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.375956 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:06.376356 (+ 400us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:06.376357 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:06.376364 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:06.376377 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:06.376539 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:06.376540 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:06.376541 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 16:16:06.376578 (+ 37us) client_negotiation.cc:240] Negotiation successful
0809 16:16:06.376592 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 16:16:06.376664 4105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.375765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:43913 (local address 127.27.217.2:41495)
0809 16:16:06.375819 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.375821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.375832 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:16:06.375861 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.375862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.375868 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.375923 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.376460 (+ 537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.376462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.376462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.376467 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.376486 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.376490 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.376538 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.376589 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.376602 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:16:06.376775 4107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.375795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:33657 (local address 127.27.217.1:41237)
0809 16:16:06.375837 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.375839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.375998 (+ 159us) server_negotiation.cc:407] Connection header received
0809 16:16:06.376023 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.376024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.376029 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.376063 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.376578 (+ 515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.376579 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.376580 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.376584 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.376599 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.376602 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.376647 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.376693 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.376707 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:16:06.376801 4122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.375707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:41237 (local address 127.27.217.3:33657)
0809 16:16:06.375907 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.375916 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.375966 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.376085 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.376086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.376087 (+ 1us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:06.376487 (+ 400us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:06.376488 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:06.376494 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:06.376506 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:06.376651 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:06.376652 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:06.376652 (+ 0us) client_negotiation.cc:769] Sending connection context
0809 16:16:06.376695 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:16:06.376707 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":126,"threads_started":1}
I20260809 16:16:06.377059 3781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba814b3f421345fa864b29bd20d2ed0f" candidate_uuid: "434c0169e2924c42b756c1e3b7d43678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975db7e8ff344a4da04f55bea925ab71" is_pre_election: true
I20260809 16:16:06.377203 3781 raft_consensus.cc:2454] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434c0169e2924c42b756c1e3b7d43678 in term 0.
I20260809 16:16:06.377180 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba814b3f421345fa864b29bd20d2ed0f" candidate_uuid: "434c0169e2924c42b756c1e3b7d43678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50c10e77df1b43e5a59446d5dc7605d9" is_pre_election: true
I20260809 16:16:06.377323 3548 raft_consensus.cc:2454] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434c0169e2924c42b756c1e3b7d43678 in term 0.
I20260809 16:16:06.377444 3893 leader_election.cc:302] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434c0169e2924c42b756c1e3b7d43678, 975db7e8ff344a4da04f55bea925ab71; no voters:
I20260809 16:16:06.377569 4114 raft_consensus.cc:2781] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:06.377611 4114 raft_consensus.cc:482] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:06.377632 4114 raft_consensus.cc:3037] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:06.378386 4114 raft_consensus.cc:504] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.378510 4114 leader_election.cc:288] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [CANDIDATE]: Term 1 election: Requested vote from peers 975db7e8ff344a4da04f55bea925ab71 (127.27.217.2:41495), 50c10e77df1b43e5a59446d5dc7605d9 (127.27.217.1:41237)
I20260809 16:16:06.378652 3781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba814b3f421345fa864b29bd20d2ed0f" candidate_uuid: "434c0169e2924c42b756c1e3b7d43678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975db7e8ff344a4da04f55bea925ab71"
I20260809 16:16:06.378720 3781 raft_consensus.cc:3037] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:06.379380 3781 raft_consensus.cc:2454] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434c0169e2924c42b756c1e3b7d43678 in term 1.
W20260809 16:16:06.379487 3861 tablet.cc:2369] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:06.379489 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba814b3f421345fa864b29bd20d2ed0f" candidate_uuid: "434c0169e2924c42b756c1e3b7d43678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50c10e77df1b43e5a59446d5dc7605d9"
I20260809 16:16:06.379547 3893 leader_election.cc:302] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434c0169e2924c42b756c1e3b7d43678, 975db7e8ff344a4da04f55bea925ab71; no voters:
I20260809 16:16:06.379570 3548 raft_consensus.cc:3037] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:06.379639 4114 raft_consensus.cc:2781] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:06.379808 4114 raft_consensus.cc:686] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 1 LEADER]: Becoming Leader. State: Replica: 434c0169e2924c42b756c1e3b7d43678, State: Running, Role: LEADER
I20260809 16:16:06.379932 4114 consensus_queue.cc:237] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } }
I20260809 16:16:06.380462 3548 raft_consensus.cc:2454] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 434c0169e2924c42b756c1e3b7d43678 in term 1.
I20260809 16:16:06.380973 3295 catalog_manager.cc:5495] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 434c0169e2924c42b756c1e3b7d43678 (127.27.217.3). New cstate: current_term: 1 leader_uuid: "434c0169e2924c42b756c1e3b7d43678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434c0169e2924c42b756c1e3b7d43678" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 43539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260809 16:16:06.402256 4103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.401372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51328 (local address 127.27.217.3:43539)
0809 16:16:06.401428 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.401430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.401438 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:06.401519 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.401520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.401536 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.401589 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.402056 (+ 467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.402058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.402058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.402062 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.402077 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.402081 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.402125 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.402172 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.402184 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:16:06.403877 3548 raft_consensus.cc:1261] T ba814b3f421345fa864b29bd20d2ed0f P 50c10e77df1b43e5a59446d5dc7605d9 [term 1 FOLLOWER]: Refusing update from remote peer 434c0169e2924c42b756c1e3b7d43678: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:06.403887 3781 raft_consensus.cc:1261] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 1 FOLLOWER]: Refusing update from remote peer 434c0169e2924c42b756c1e3b7d43678: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:06.404184 4124 consensus_queue.cc:1035] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50c10e77df1b43e5a59446d5dc7605d9" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:06.404294 4114 consensus_queue.cc:1035] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975db7e8ff344a4da04f55bea925ab71" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 41495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:06.407361 4132 mvcc.cc:205] Tried to move back new op lower bound from 7316652713587949568 to 7316652713492836352. Current Snapshot: MvccSnapshot[applied={T|T < 7316652713587949568}]
I20260809 16:16:06.407261 4127 mvcc.cc:205] Tried to move back new op lower bound from 7316652713587949568 to 7316652713492836352. Current Snapshot: MvccSnapshot[applied={T|T < 7316652713587949568 or (T in {7316652713587949568})}]
I20260809 16:16:06.408706 3295 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:06.408784 3295 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:06.409466 3295 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 098c2d8dd19f4cf18ba50db43cdf350c: Sending DeleteTablet for 3 replicas of tablet ba814b3f421345fa864b29bd20d2ed0f
I20260809 16:16:06.409780 3977 tablet_service.cc:1514] Processing DeleteTablet for tablet ba814b3f421345fa864b29bd20d2ed0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:06 UTC) from {username='slave'} at 127.0.0.1:51326
I20260809 16:16:06.409802 3743 tablet_service.cc:1514] Processing DeleteTablet for tablet ba814b3f421345fa864b29bd20d2ed0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:06 UTC) from {username='slave'} at 127.0.0.1:46972
I20260809 16:16:06.410140 4143 tablet_replica.cc:330] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: stopping tablet replica
I20260809 16:16:06.410151 4145 tablet_replica.cc:330] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: stopping tablet replica
I20260809 16:16:06.410142 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet ba814b3f421345fa864b29bd20d2ed0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:06 UTC) from {username='slave'} at 127.0.0.1:54394
I20260809 16:16:06.410241 4143 raft_consensus.cc:2229] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:06.410255 4145 raft_consensus.cc:2229] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:06.410326 4143 raft_consensus.cc:2258] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:06.410352 4145 raft_consensus.cc:2258] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:06.410411 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 3405
I20260809 16:16:06.410720 4143 ts_tablet_manager.cc:1905] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:06.412758 4143 ts_tablet_manager.cc:1918] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:06.412832 4143 log.cc:1196] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/ba814b3f421345fa864b29bd20d2ed0f
I20260809 16:16:06.413147 4143 ts_tablet_manager.cc:1939] T ba814b3f421345fa864b29bd20d2ed0f P 434c0169e2924c42b756c1e3b7d43678: Deleting consensus metadata
I20260809 16:16:06.413574 4145 ts_tablet_manager.cc:1905] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:06.413564 3264 catalog_manager.cc:4841] TS 434c0169e2924c42b756c1e3b7d43678 (127.27.217.3:43539): tablet ba814b3f421345fa864b29bd20d2ed0f (table test-table [id=ad900f6c10a2411d8edf96f8653597a4]) successfully deleted
I20260809 16:16:06.415177 4145 ts_tablet_manager.cc:1918] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:06.415251 4145 log.cc:1196] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/ba814b3f421345fa864b29bd20d2ed0f
I20260809 16:16:06.415493 4145 ts_tablet_manager.cc:1939] T ba814b3f421345fa864b29bd20d2ed0f P 975db7e8ff344a4da04f55bea925ab71: Deleting consensus metadata
I20260809 16:16:06.424345 3268 catalog_manager.cc:4841] TS 975db7e8ff344a4da04f55bea925ab71 (127.27.217.2:41495): tablet ba814b3f421345fa864b29bd20d2ed0f (table test-table [id=ad900f6c10a2411d8edf96f8653597a4]) successfully deleted
W20260809 16:16:06.427289 3264 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:41237 (error 108)
I20260809 16:16:06.427814 4104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.427621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:41237 (local address 127.0.0.1:54402)
0809 16:16:06.427730 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.427778 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:41237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 16:16:06.427874 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 3634
W20260809 16:16:06.431977 3264 catalog_manager.cc:4584] TS 50c10e77df1b43e5a59446d5dc7605d9 (127.27.217.1:41237): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ba814b3f421345fa864b29bd20d2ed0f: Network error: Client connection negotiation failed: client connection to 127.27.217.1:41237: connect: Connection refused (error 111)
I20260809 16:16:06.434444 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 3863
I20260809 16:16:06.444823 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 3241
2026-08-09T16:16:06Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (733 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 16:16:06.468475 28516 mini_oidc.cc:152] Starting JWKS server
I20260809 16:16:06.469565 28516 webserver.cc:460] Webserver started at https://127.0.0.1:40657/ using document root <none> and password file <none>
I20260809 16:16:06.469650 28516 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 16:16:06.469780 28516 webserver.cc:460] Webserver started at http://127.0.0.1:33555/ using document root <none> and password file <none>
2026-08-09T16:16:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:06Z Disabled control of system clock
I20260809 16:16:06.477660 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:33605
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:44121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:33605
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40657/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/testchainca.cert with env {}
W20260809 16:16:06.555999 4157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:06.556187 4157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:06.556207 4157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:06.557318 4157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:06.557351 4157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:06.557363 4157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:06.557374 4157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:06.557386 4157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 16:16:06.557397 4157 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 16:16:06.557413 4157 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40657/jwks.json
I20260809 16:16:06.558872 4157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:33605
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:33605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40657/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:06.559055 4157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:06.559204 4157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:06.563575 4171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:06.563691 4157 server_base.cc:1034] running on GCE node
W20260809 16:16:06.563577 4165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:06.563575 4168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:06.564016 4157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:06.564289 4157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:06.565419 4157 hybrid_clock.cc:648] HybridClock initialized: now 1786292166565408 us; error 34 us; skew 500 ppm
I20260809 16:16:06.566551 4157 webserver.cc:460] Webserver started at http://127.27.217.62:42293/ using document root <none> and password file <none>
I20260809 16:16:06.566751 4157 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:06.566797 4157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:06.566913 4157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:06.567915 4157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "7b57709ef29f40dbbdd1f2c5343617d3"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "a3025a2f5806307ea2a56ed9efcdcc67"
server_key_iv: "7c506b20b96ee09a9a20372c140d944b"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.568223 4157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "7b57709ef29f40dbbdd1f2c5343617d3"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "a3025a2f5806307ea2a56ed9efcdcc67"
server_key_iv: "7c506b20b96ee09a9a20372c140d944b"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.569399 4157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:06.570016 4180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.570151 4157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:06.570235 4157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "7b57709ef29f40dbbdd1f2c5343617d3"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "a3025a2f5806307ea2a56ed9efcdcc67"
server_key_iv: "7c506b20b96ee09a9a20372c140d944b"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.570297 4157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:06.583199 4157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:06.583470 4157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:06.583609 4157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:06.587389 4157 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:33605
I20260809 16:16:06.587432 4260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:33605 every 8 connection(s)
I20260809 16:16:06.587767 4157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:06.588656 4261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:06.590832 4261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3: Bootstrap starting.
I20260809 16:16:06.591346 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 4157
I20260809 16:16:06.591389 4261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:06.591439 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:06.591617 28516 external_mini_cluster.cc:1428] Setting key 89287005722c1a54888f44f3c5e7e64d
I20260809 16:16:06.591660 4261 log.cc:824] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:06.592494 4261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3: No bootstrap required, opened a new log
I20260809 16:16:06.594921 4261 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b57709ef29f40dbbdd1f2c5343617d3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33605 } }
I20260809 16:16:06.595053 4261 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:06.595074 4261 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b57709ef29f40dbbdd1f2c5343617d3, State: Initialized, Role: FOLLOWER
I20260809 16:16:06.595180 4261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b57709ef29f40dbbdd1f2c5343617d3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33605 } }
I20260809 16:16:06.595261 4261 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:06.595297 4261 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:06.595341 4261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:06.595901 4261 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b57709ef29f40dbbdd1f2c5343617d3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33605 } }
I20260809 16:16:06.595999 4261 leader_election.cc:302] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b57709ef29f40dbbdd1f2c5343617d3; no voters:
I20260809 16:16:06.596163 4261 leader_election.cc:288] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:06.596203 4269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:06.596446 4261 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:06.596678 4269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7b57709ef29f40dbbdd1f2c5343617d3, State: Running, Role: LEADER
I20260809 16:16:06.596833 4269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b57709ef29f40dbbdd1f2c5343617d3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33605 } }
I20260809 16:16:06.597460 4268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.592061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56200 (local address 127.27.217.62:33605)
0809 16:16:06.592265 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.592274 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.592310 (+ 36us) server_negotiation.cc:407] Connection header received
0809 16:16:06.592858 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.592867 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.592942 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.593087 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.593249 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.594573 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.595457 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.595897 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.596016 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:06.596676 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.596680 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.596680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.596856 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.596888 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.596898 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.597134 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.597168 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.597253 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
I20260809 16:16:06.598189 4271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b57709ef29f40dbbdd1f2c5343617d3. Latest consensus state: current_term: 1 leader_uuid: "7b57709ef29f40dbbdd1f2c5343617d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b57709ef29f40dbbdd1f2c5343617d3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33605 } } }
I20260809 16:16:06.598244 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:16:06.598284 4271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:06.598466 4270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b57709ef29f40dbbdd1f2c5343617d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b57709ef29f40dbbdd1f2c5343617d3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33605 } } }
W20260809 16:16:06.598519 4291 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 16:16:06.598538 4270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3 [sys.catalog]: This master's current role is: LEADER
W20260809 16:16:06.598589 4291 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:16:06.598711 4293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:06.598867 4293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:06.600297 4293 catalog_manager.cc:1347] Generated new cluster ID: 460e04d4e14c4384ad7640156cb60d8e
I20260809 16:16:06.600340 4293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:06.607348 4293 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:06.607905 4293 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:06.609841 4293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b57709ef29f40dbbdd1f2c5343617d3: Generated new TSK 0
I20260809 16:16:06.609975 4293 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 16:16:06.642441 4307 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 16:16:06.642555 4307 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 16:16:06.642851 4268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.621530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56212 (local address 127.27.217.62:33605)
0809 16:16:06.621582 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.621584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.621703 (+ 119us) server_negotiation.cc:407] Connection header received
0809 16:16:06.621796 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.621797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.621809 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.621867 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0809 16:16:06.622018 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.622518 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.623238 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.623437 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.623490 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:06.623699 (+ 209us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 16:16:06.642626 (+ 18927us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40657/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 16:16:06.642782 (+ 156us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56212: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40657/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":26}
W20260809 16:16:06.642928 4268 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56212: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40657/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 16:16:06.643224 4306 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:06.621449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33605 (local address 127.0.0.1:56212)
0809 16:16:06.621631 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.621641 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.621706 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.621878 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.621879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.621885 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0809 16:16:06.621956 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:06.621958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.622590 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.622591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:06.623160 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:06.623162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.623498 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.623498 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:06.623564 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:06.623584 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 16:16:06.642741 (+ 19157us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40657/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 16:16:06.642844 (+ 103us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.217.62:33605: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40657/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.27.217.62:33605: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40657/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 16:16:06.643584 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 4157
2026-08-09T16:16:06Z chronyd exiting
I20260809 16:16:06.699162 28516 test_util.cc:175] -----------------------------------------------
I20260809 16:16:06.699242 28516 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786292143139430-28516-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (231 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 16:16:06.700170 28516 mini_oidc.cc:152] Starting JWKS server
I20260809 16:16:06.700881 28516 webserver.cc:460] Webserver started at https://127.0.0.1:39201/ using document root <none> and password file <none>
I20260809 16:16:06.700923 28516 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 16:16:06.701067 28516 webserver.cc:460] Webserver started at http://127.0.0.1:46135/ using document root <none> and password file <none>
2026-08-09T16:16:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:06Z Disabled control of system clock
I20260809 16:16:06.709218 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41457
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:41095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41457
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39201/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/testchainca.cert with env {}
W20260809 16:16:06.787411 4320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:06.787597 4320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:06.787617 4320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:06.788738 4320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:06.788777 4320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:06.788789 4320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:06.788800 4320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:06.788810 4320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 16:16:06.788825 4320 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 16:16:06.788836 4320 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39201/jwks.json
I20260809 16:16:06.790288 4320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:41095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41457
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39201/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:06.790480 4320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:06.790639 4320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:06.794993 4337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:06.795018 4330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:06.795128 4320 server_base.cc:1034] running on GCE node
W20260809 16:16:06.795264 4335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:06.795487 4320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:06.795799 4320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:06.796929 4320 hybrid_clock.cc:648] HybridClock initialized: now 1786292166796922 us; error 28 us; skew 500 ppm
I20260809 16:16:06.798032 4320 webserver.cc:460] Webserver started at http://127.27.217.62:45331/ using document root <none> and password file <none>
I20260809 16:16:06.798247 4320 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:06.798290 4320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:06.798405 4320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:06.799364 4320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "79d49fffb8c64377a6e93cadfd327774"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "643e370a7ab03b39850a32469bcf81fc"
server_key_iv: "271a0b7d96c7afc8bb9ed623b082e7bd"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.799716 4320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "79d49fffb8c64377a6e93cadfd327774"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "643e370a7ab03b39850a32469bcf81fc"
server_key_iv: "271a0b7d96c7afc8bb9ed623b082e7bd"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.800954 4320 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:06.801608 4347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:06.801762 4320 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:06.801842 4320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "79d49fffb8c64377a6e93cadfd327774"
format_stamp: "Formatted at 2026-08-09 16:16:06 on dist-test-slave-nj21"
server_key: "643e370a7ab03b39850a32469bcf81fc"
server_key_iv: "271a0b7d96c7afc8bb9ed623b082e7bd"
server_key_version: "encryptionkey@0"
I20260809 16:16:06.801909 4320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:06.814200 4320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:06.814435 4320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:06.814551 4320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:06.818200 4320 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:41457
I20260809 16:16:06.818233 4441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:41457 every 8 connection(s)
I20260809 16:16:06.818511 4320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:06.819132 4445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:06.821700 4445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774: Bootstrap starting.
I20260809 16:16:06.822214 4445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:06.822430 4445 log.cc:824] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:06.822975 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 4320
I20260809 16:16:06.823056 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:06.823083 4445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774: No bootstrap required, opened a new log
I20260809 16:16:06.823221 28516 external_mini_cluster.cc:1428] Setting key 4e141d20509a1113af20186cb1e5abd6
I20260809 16:16:06.825495 4445 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d49fffb8c64377a6e93cadfd327774" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41457 } }
I20260809 16:16:06.825627 4445 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:06.825661 4445 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d49fffb8c64377a6e93cadfd327774, State: Initialized, Role: FOLLOWER
I20260809 16:16:06.825816 4445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d49fffb8c64377a6e93cadfd327774" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41457 } }
I20260809 16:16:06.825883 4445 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:06.825904 4445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:06.825948 4445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:06.826622 4445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d49fffb8c64377a6e93cadfd327774" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41457 } }
I20260809 16:16:06.826718 4445 leader_election.cc:302] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79d49fffb8c64377a6e93cadfd327774; no voters:
I20260809 16:16:06.826879 4445 leader_election.cc:288] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:06.826922 4452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:06.827133 4452 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [term 1 LEADER]: Becoming Leader. State: Replica: 79d49fffb8c64377a6e93cadfd327774, State: Running, Role: LEADER
I20260809 16:16:06.827154 4445 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:06.827272 4452 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d49fffb8c64377a6e93cadfd327774" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41457 } }
I20260809 16:16:06.827594 4452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79d49fffb8c64377a6e93cadfd327774. Latest consensus state: current_term: 1 leader_uuid: "79d49fffb8c64377a6e93cadfd327774" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d49fffb8c64377a6e93cadfd327774" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41457 } } }
I20260809 16:16:06.827659 4452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:06.827809 4455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79d49fffb8c64377a6e93cadfd327774" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d49fffb8c64377a6e93cadfd327774" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41457 } } }
I20260809 16:16:06.827884 4466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:06.827967 4455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:06.828539 4466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:06.828869 4451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.823659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39038 (local address 127.27.217.62:41457)
0809 16:16:06.823867 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.823874 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.823897 (+ 23us) server_negotiation.cc:407] Connection header received
0809 16:16:06.824339 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.824346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.824406 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.824510 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:06.824737 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.825591 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.826491 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.826991 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.827414 (+ 423us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:06.827869 (+ 455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:06.827873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:06.827873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:06.828064 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:06.828103 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:06.828117 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:06.828410 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:06.828442 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 16:16:06.828514 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260809 16:16:06.829865 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:16:06.830185 4466 catalog_manager.cc:1347] Generated new cluster ID: 0b3198158f4a46cb8caff6ca27dc57ad
I20260809 16:16:06.830231 4466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:06.851107 4466 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:06.851614 4466 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:06.854995 4466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79d49fffb8c64377a6e93cadfd327774: Generated new TSK 0
I20260809 16:16:06.855134 4466 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 16:16:06.878785 4498 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 16:16:06.878973 4498 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 16:16:06.879128 4451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:06.862188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39042 (local address 127.27.217.62:41457)
0809 16:16:06.862231 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:06.862233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:06.862305 (+ 72us) server_negotiation.cc:407] Connection header received
0809 16:16:06.862378 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:06.862379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:06.862388 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:06.862443 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0809 16:16:06.862576 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.863055 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.864169 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.864371 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.864420 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:06.864574 (+ 154us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 16:16:06.878924 (+ 14350us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 16:16:06.879058 (+ 134us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39042: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":24}
W20260809 16:16:06.879186 4451 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39042: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 16:16:06.879504 4497 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:06.862104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41457 (local address 127.0.0.1:39042)
0809 16:16:06.862239 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:06.862249 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:06.862313 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:06.862454 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:06.862455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:06.862457 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 16:16:06.862523 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:06.862525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.863116 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.863117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:06.864093 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:06.864096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:06.864432 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:06.864433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:06.864495 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:06.864501 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 16:16:06.879290 (+ 14789us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 16:16:06.879406 (+ 116us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.217.62:41457: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
I20260809 16:16:06.880668 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 4320
2026-08-09T16:16:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (222 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 16:16:06.922526 28516 mini_oidc.cc:152] Starting JWKS server
I20260809 16:16:06.923193 28516 webserver.cc:460] Webserver started at https://127.0.0.1:44227/ using document root <none> and password file <none>
I20260809 16:16:06.923238 28516 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 16:16:06.923381 28516 webserver.cc:460] Webserver started at http://127.0.0.1:35139/ using document root <none> and password file <none>
2026-08-09T16:16:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:06Z Disabled control of system clock
I20260809 16:16:06.931430 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35095
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:37105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:35095
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44227/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 16:16:07.009724 4507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:07.009917 4507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:07.009948 4507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:07.011070 4507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:07.011111 4507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:07.011126 4507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:07.011142 4507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:07.011157 4507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 16:16:07.011181 4507 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 16:16:07.011204 4507 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44227/jwks.json
I20260809 16:16:07.012581 4507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:37105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:35095
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44227/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:07.012821 4507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:07.013085 4507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:07.017541 4522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:07.017655 4507 server_base.cc:1034] running on GCE node
W20260809 16:16:07.017552 4521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:07.017552 4527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:07.017967 4507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:07.018242 4507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:07.019371 4507 hybrid_clock.cc:648] HybridClock initialized: now 1786292167019352 us; error 37 us; skew 500 ppm
I20260809 16:16:07.020555 4507 webserver.cc:460] Webserver started at http://127.27.217.62:37909/ using document root <none> and password file <none>
I20260809 16:16:07.020756 4507 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:07.020800 4507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:07.020923 4507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:07.021903 4507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "8f14dba5a25e4032b575a2068a4d69af"
format_stamp: "Formatted at 2026-08-09 16:16:07 on dist-test-slave-nj21"
server_key: "6f58af48fc8f447e930e3630b4e82fd8"
server_key_iv: "a30fd3f85c4a3785f514644e49ca82a2"
server_key_version: "encryptionkey@0"
I20260809 16:16:07.022226 4507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "8f14dba5a25e4032b575a2068a4d69af"
format_stamp: "Formatted at 2026-08-09 16:16:07 on dist-test-slave-nj21"
server_key: "6f58af48fc8f447e930e3630b4e82fd8"
server_key_iv: "a30fd3f85c4a3785f514644e49ca82a2"
server_key_version: "encryptionkey@0"
I20260809 16:16:07.023413 4507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:07.024153 4536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:07.024294 4507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:07.024379 4507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "8f14dba5a25e4032b575a2068a4d69af"
format_stamp: "Formatted at 2026-08-09 16:16:07 on dist-test-slave-nj21"
server_key: "6f58af48fc8f447e930e3630b4e82fd8"
server_key_iv: "a30fd3f85c4a3785f514644e49ca82a2"
server_key_version: "encryptionkey@0"
I20260809 16:16:07.024433 4507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:07.041085 4507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:07.041326 4507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:07.041424 4507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:07.045027 4507 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:35095
I20260809 16:16:07.045060 4622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:35095 every 8 connection(s)
I20260809 16:16:07.045351 4507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:07.045970 4623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:07.048509 4623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af: Bootstrap starting.
I20260809 16:16:07.049055 4623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:07.049306 4623 log.cc:824] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:07.049953 4623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af: No bootstrap required, opened a new log
I20260809 16:16:07.051461 4623 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f14dba5a25e4032b575a2068a4d69af" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35095 } }
I20260809 16:16:07.051599 4623 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:07.051632 4623 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f14dba5a25e4032b575a2068a4d69af, State: Initialized, Role: FOLLOWER
I20260809 16:16:07.051816 4623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f14dba5a25e4032b575a2068a4d69af" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35095 } }
I20260809 16:16:07.051887 4623 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:07.051918 4623 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:07.051965 4623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:07.052474 4623 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f14dba5a25e4032b575a2068a4d69af" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35095 } }
I20260809 16:16:07.052569 4623 leader_election.cc:302] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f14dba5a25e4032b575a2068a4d69af; no voters:
I20260809 16:16:07.052726 4623 leader_election.cc:288] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:07.052762 4627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:07.052903 4627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [term 1 LEADER]: Becoming Leader. State: Replica: 8f14dba5a25e4032b575a2068a4d69af, State: Running, Role: LEADER
I20260809 16:16:07.052955 4623 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:07.053032 4627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f14dba5a25e4032b575a2068a4d69af" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35095 } }
I20260809 16:16:07.053383 4628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f14dba5a25e4032b575a2068a4d69af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f14dba5a25e4032b575a2068a4d69af" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35095 } } }
I20260809 16:16:07.053470 4628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:07.053529 4631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f14dba5a25e4032b575a2068a4d69af. Latest consensus state: current_term: 1 leader_uuid: "8f14dba5a25e4032b575a2068a4d69af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f14dba5a25e4032b575a2068a4d69af" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35095 } } }
I20260809 16:16:07.053589 4631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:07.053790 4647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:07.054288 4647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:07.055338 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 4507
I20260809 16:16:07.055447 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:07.055621 28516 external_mini_cluster.cc:1428] Setting key 45728562d6a56e54b9241c1a9ec205f2
I20260809 16:16:07.055800 4647 catalog_manager.cc:1347] Generated new cluster ID: 1a3cd91c76524c759943b008758d17ed
I20260809 16:16:07.055850 4647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:07.064533 4647 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:07.065169 4647 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:07.069202 4662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:07.056039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43294 (local address 127.27.217.62:35095)
0809 16:16:07.064093 (+ 8054us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:07.064101 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:07.064138 (+ 37us) server_negotiation.cc:407] Connection header received
0809 16:16:07.064240 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:07.064245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:07.064315 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:07.064459 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:07.064706 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.066061 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.067137 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.067762 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.067873 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:07.068529 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:07.068533 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:07.068533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:07.068734 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:07.068772 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:07.068785 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:07.068841 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:07.068905 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 16:16:07.068990 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":7982,"thread_start_us":62,"threads_started":1}
I20260809 16:16:07.070091 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:16:07.076570 4647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f14dba5a25e4032b575a2068a4d69af: Generated new TSK 0
I20260809 16:16:07.076730 4647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:16:07.085846 4662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:07.082618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43302 (local address 127.27.217.62:35095)
0809 16:16:07.082659 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:07.082661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:07.082743 (+ 82us) server_negotiation.cc:407] Connection header received
0809 16:16:07.082813 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:07.082814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:07.082823 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:07.082878 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0809 16:16:07.083007 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.083464 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.084569 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.084767 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.084809 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:07.084968 (+ 159us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 16:16:07.085667 (+ 699us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44227/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 16:16:07.085785 (+ 118us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43302: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44227/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 16:16:07.085906 4662 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43302: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44227/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 16:16:07.085947 4676 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:07.082542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35095 (local address 127.0.0.1:43302)
0809 16:16:07.082677 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:07.082688 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:07.082750 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:07.082887 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:07.082888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:07.082890 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 16:16:07.082947 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:07.082950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.083525 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.083526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:07.084494 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:07.084497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.084827 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.084828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:07.084885 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:07.084891 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 16:16:07.085757 (+ 866us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44227/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 16:16:07.085840 (+ 83us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.217.62:35095: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44227/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
I20260809 16:16:07.086258 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 4507
E20260809 16:16:07.110939 4678 webserver.cc:533] Webserver: sslize failed:
E20260809 16:16:07.111023 4678 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T16:16:07Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (215 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T16:16:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:07Z Disabled control of system clock
I20260809 16:16:07.145772 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:37553
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:34279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:37553
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/testchainca.cert with env {}
W20260809 16:16:07.224831 4688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:07.225044 4688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:07.225067 4688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:07.226158 4688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:07.226190 4688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:07.226202 4688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:07.226212 4688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:07.226222 4688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 16:16:07.226233 4688 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 16:16:07.226243 4688 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 16:16:07.227660 4688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:34279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:37553
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:37553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:07.227877 4688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:07.228040 4688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:07.232470 4703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:07.232470 4697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:07.232576 4688 server_base.cc:1034] running on GCE node
W20260809 16:16:07.232645 4695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:07.232894 4688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:07.233184 4688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:07.234349 4688 hybrid_clock.cc:648] HybridClock initialized: now 1786292167234332 us; error 30 us; skew 500 ppm
I20260809 16:16:07.235519 4688 webserver.cc:460] Webserver started at http://127.27.217.62:35557/ using document root <none> and password file <none>
I20260809 16:16:07.235805 4688 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:07.235853 4688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:07.235980 4688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:07.236958 4688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "6315e7f2778747ca9adf2b71e682f89a"
format_stamp: "Formatted at 2026-08-09 16:16:07 on dist-test-slave-nj21"
server_key: "d20455d7a3578b003e6963f6cb741ffc"
server_key_iv: "c393ef677b55f10222aaa7d7e4c633f1"
server_key_version: "encryptionkey@0"
I20260809 16:16:07.237272 4688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "6315e7f2778747ca9adf2b71e682f89a"
format_stamp: "Formatted at 2026-08-09 16:16:07 on dist-test-slave-nj21"
server_key: "d20455d7a3578b003e6963f6cb741ffc"
server_key_iv: "c393ef677b55f10222aaa7d7e4c633f1"
server_key_version: "encryptionkey@0"
I20260809 16:16:07.238461 4688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:16:07.239086 4715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:07.239220 4688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:07.239305 4688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "6315e7f2778747ca9adf2b71e682f89a"
format_stamp: "Formatted at 2026-08-09 16:16:07 on dist-test-slave-nj21"
server_key: "d20455d7a3578b003e6963f6cb741ffc"
server_key_iv: "c393ef677b55f10222aaa7d7e4c633f1"
server_key_version: "encryptionkey@0"
I20260809 16:16:07.239367 4688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:07.264632 4688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:07.264933 4688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:07.265036 4688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:07.268664 4688 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:37553
I20260809 16:16:07.268707 4805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:37553 every 8 connection(s)
I20260809 16:16:07.269022 4688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:07.269919 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 4688
I20260809 16:16:07.270001 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:07.269986 4806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:07.270195 28516 external_mini_cluster.cc:1428] Setting key f82e7ffd897da12a144349dce15e35d6
I20260809 16:16:07.273298 4806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a: Bootstrap starting.
I20260809 16:16:07.273880 4806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:07.274174 4806 log.cc:824] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:07.275077 4806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a: No bootstrap required, opened a new log
I20260809 16:16:07.276059 4810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:07.270698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47716 (local address 127.27.217.62:37553)
0809 16:16:07.270908 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:07.270917 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:07.270950 (+ 33us) server_negotiation.cc:407] Connection header received
0809 16:16:07.271413 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:07.271431 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:07.271514 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:07.271664 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:07.271900 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.273200 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.273955 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.274519 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.274606 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:07.275343 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:07.275347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:07.275347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:07.275547 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:07.275589 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:07.275605 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:07.275690 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:07.275763 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 16:16:07.275840 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
I20260809 16:16:07.277050 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:16:07.277294 4806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315e7f2778747ca9adf2b71e682f89a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37553 } }
I20260809 16:16:07.277448 4806 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:07.277484 4806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6315e7f2778747ca9adf2b71e682f89a, State: Initialized, Role: FOLLOWER
I20260809 16:16:07.277604 4806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315e7f2778747ca9adf2b71e682f89a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37553 } }
I20260809 16:16:07.277673 4806 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:07.277706 4806 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:07.277751 4806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:07.278344 4806 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315e7f2778747ca9adf2b71e682f89a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37553 } }
I20260809 16:16:07.278441 4806 leader_election.cc:302] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6315e7f2778747ca9adf2b71e682f89a; no voters:
I20260809 16:16:07.278589 4806 leader_election.cc:288] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:07.278646 4815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:07.278796 4815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [term 1 LEADER]: Becoming Leader. State: Replica: 6315e7f2778747ca9adf2b71e682f89a, State: Running, Role: LEADER
I20260809 16:16:07.278817 4806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:07.278889 4815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315e7f2778747ca9adf2b71e682f89a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37553 } }
I20260809 16:16:07.279219 4816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6315e7f2778747ca9adf2b71e682f89a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315e7f2778747ca9adf2b71e682f89a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37553 } } }
I20260809 16:16:07.279300 4820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6315e7f2778747ca9adf2b71e682f89a. Latest consensus state: current_term: 1 leader_uuid: "6315e7f2778747ca9adf2b71e682f89a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315e7f2778747ca9adf2b71e682f89a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37553 } } }
I20260809 16:16:07.279306 4816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:07.279376 4820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:07.279801 4826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:07.280253 4826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:07.284355 4826 catalog_manager.cc:1347] Generated new cluster ID: d7e63ebc3761482fa80c5051f2e97f5a
I20260809 16:16:07.284415 4826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:07.291710 4826 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:07.292371 4826 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:07.303452 4826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6315e7f2778747ca9adf2b71e682f89a: Generated new TSK 0
I20260809 16:16:07.303617 4826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:16:07.326682 4810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:07.313722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47718 (local address 127.27.217.62:37553)
0809 16:16:07.313764 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:07.313766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:07.313856 (+ 90us) server_negotiation.cc:407] Connection header received
0809 16:16:07.313936 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:07.313937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:07.313947 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:07.313996 (+ 49us) server_negotiation.cc:226] Negotiated authn=JWT
0809 16:16:07.314120 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.314614 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.315758 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.315939 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.315984 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:07.316155 (+ 171us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 16:16:07.326466 (+ 10311us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 16:16:07.326610 (+ 144us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47718: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 16:16:07.326756 4810 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47718: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 16:16:07.326894 4850 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:07.313649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:37553 (local address 127.0.0.1:47718)
0809 16:16:07.313786 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:07.313797 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:07.313861 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:07.314007 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:07.314008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:07.314010 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 16:16:07.314067 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:07.314069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.314680 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.314681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:07.315633 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:07.315636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:07.316002 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:07.316003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:07.316071 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:07.316076 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 16:16:07.326613 (+ 10537us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 16:16:07.326748 (+ 135us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.217.62:37553: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
I20260809 16:16:07.327386 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 4688
2026-08-09T16:16:07Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (211 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (88 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (86 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:07 dist-test-slave-nj21 krb5kdc[4873](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:07 dist-test-slave-nj21 krb5kdc[4873](info): set up 2 sockets
Aug 09 16:16:07 dist-test-slave-nj21 krb5kdc[4873](info): commencing operation
krb5kdc: starting...
W20260809 16:16:08.644739 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:08 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:16:08.758618 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:39049
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:36801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:39049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:08.837056 4900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:08.837261 4900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:08.837291 4900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:08.838425 4900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:08.838467 4900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:08.838486 4900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:08.838502 4900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:08.838517 4900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:08.839987 4900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:36801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:39049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:39049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:08.840226 4900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:08.840432 4900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:08.845038 4914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:08.845058 4911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:08.845206 4900 server_base.cc:1034] running on GCE node
W20260809 16:16:08.845037 4910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:08.845466 4900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:08.845701 4900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:08.846861 4900 hybrid_clock.cc:648] HybridClock initialized: now 1786292168846850 us; error 28 us; skew 500 ppm
Aug 09 16:16:08 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292168, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:08.849172 4900 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:16:08.849570 4900 webserver.cc:460] Webserver started at http://127.27.217.62:38867/ using document root <none> and password file <none>
I20260809 16:16:08.849783 4900 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:08.849826 4900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:08.849946 4900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:08.850939 4900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "001fc53170a6428fac8d663e880a01d5"
format_stamp: "Formatted at 2026-08-09 16:16:08 on dist-test-slave-nj21"
server_key: "9ce99d4995e822bf6b1585d83b7e9be1"
server_key_iv: "5a847e061cf76c296e87930cea0a8f21"
server_key_version: "encryptionkey@0"
I20260809 16:16:08.851258 4900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "001fc53170a6428fac8d663e880a01d5"
format_stamp: "Formatted at 2026-08-09 16:16:08 on dist-test-slave-nj21"
server_key: "9ce99d4995e822bf6b1585d83b7e9be1"
server_key_iv: "5a847e061cf76c296e87930cea0a8f21"
server_key_version: "encryptionkey@0"
I20260809 16:16:08.852533 4900 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:16:08.853195 4928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:08.853334 4900 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:08.853411 4900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "001fc53170a6428fac8d663e880a01d5"
format_stamp: "Formatted at 2026-08-09 16:16:08 on dist-test-slave-nj21"
server_key: "9ce99d4995e822bf6b1585d83b7e9be1"
server_key_iv: "5a847e061cf76c296e87930cea0a8f21"
server_key_version: "encryptionkey@0"
I20260809 16:16:08.853482 4900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:08.880239 4900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:08.881968 4900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:08.882084 4900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:08.886366 4900 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:39049
I20260809 16:16:08.886418 5003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:39049 every 8 connection(s)
I20260809 16:16:08.886812 4900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:08.887729 5005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:08.889983 5005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5: Bootstrap starting.
I20260809 16:16:08.890535 5005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:08.890812 5005 log.cc:824] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:08.891460 5005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5: No bootstrap required, opened a new log
I20260809 16:16:08.893154 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 4900
I20260809 16:16:08.893064 5005 raft_consensus.cc:348] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001fc53170a6428fac8d663e880a01d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39049 } }
I20260809 16:16:08.893224 5005 raft_consensus.cc:374] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:08.893260 5005 raft_consensus.cc:729] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 001fc53170a6428fac8d663e880a01d5, State: Initialized, Role: FOLLOWER
I20260809 16:16:08.893270 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:08.893404 5005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001fc53170a6428fac8d663e880a01d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39049 } }
I20260809 16:16:08.893445 28516 external_mini_cluster.cc:1428] Setting key b6c3b763bfc20895413faff21154b1cb
I20260809 16:16:08.893481 5005 raft_consensus.cc:388] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:08.893522 5005 raft_consensus.cc:482] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:08.893570 5005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:08.894479 5005 raft_consensus.cc:504] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001fc53170a6428fac8d663e880a01d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39049 } }
I20260809 16:16:08.894593 5005 leader_election.cc:302] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 001fc53170a6428fac8d663e880a01d5; no voters:
I20260809 16:16:08.894773 5005 leader_election.cc:288] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:08.894812 5011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:08.894948 5011 raft_consensus.cc:686] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [term 1 LEADER]: Becoming Leader. State: Replica: 001fc53170a6428fac8d663e880a01d5, State: Running, Role: LEADER
I20260809 16:16:08.895051 5005 sys_catalog.cc:564] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:08.895036 5011 consensus_queue.cc:237] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001fc53170a6428fac8d663e880a01d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39049 } }
I20260809 16:16:08.896282 5013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "001fc53170a6428fac8d663e880a01d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001fc53170a6428fac8d663e880a01d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39049 } } }
I20260809 16:16:08.896374 5013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:08.896289 5012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 001fc53170a6428fac8d663e880a01d5. Latest consensus state: current_term: 1 leader_uuid: "001fc53170a6428fac8d663e880a01d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001fc53170a6428fac8d663e880a01d5" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39049 } } }
I20260809 16:16:08.897540 5012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5 [sys.catalog]: This master's current role is: LEADER
W20260809 16:16:08.896857 5038 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:16:08.897642 5038 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:16:08.897703 5044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:08.897864 5044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 16:16:08 dist-test-slave-nj21 krb5kdc[4873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:08.904526 5010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:08.893909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53652 (local address 127.27.217.62:39049)
0809 16:16:08.894108 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:08.894116 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:08.894143 (+ 27us) server_negotiation.cc:407] Connection header received
0809 16:16:08.894230 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:08.894244 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:08.894284 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:08.894390 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:08.895156 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:08.896550 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:08.897369 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:08.897945 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:08.898047 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:08.900329 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:08.900334 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:08.900334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:08.900346 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:08.902641 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:08.903067 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:08.903070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:08.903070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:08.903224 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:08.903408 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:08.903408 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:08.903409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:08.903764 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:08.903934 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:08.904041 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 16:16:08.904314 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
I20260809 16:16:08.904702 5044 catalog_manager.cc:1347] Generated new cluster ID: a3266b295dbd4ce5ac94efd063bfba45
I20260809 16:16:08.904749 5044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:08.916105 5044 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:08.916858 5044 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:08.923152 5044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 001fc53170a6428fac8d663e880a01d5: Generated new TSK 0
I20260809 16:16:08.923370 5044 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:16:08.956427 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39049
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:36801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:09.035789 5053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:09.035974 5053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:09.035995 5053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:09.037072 5053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:09.037104 5053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:09.037127 5053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:09.038520 5053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:36801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:09.038699 5053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:09.038882 5053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:16:09.043475 5053 server_base.cc:1034] running on GCE node
W20260809 16:16:09.043452 5062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:09.043529 5065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:09.043450 5063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:09.043916 5053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:09.044133 5053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:09.045279 5053 hybrid_clock.cc:648] HybridClock initialized: now 1786292169045264 us; error 29 us; skew 500 ppm
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.047689 5053 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:16:09.048076 5053 webserver.cc:460] Webserver started at http://127.27.217.1:45683/ using document root <none> and password file <none>
I20260809 16:16:09.048250 5053 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:09.048290 5053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:09.048375 5053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:09.049336 5053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "96d8959fd20642988f5c20b88e106102"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "c6e2894881700186d02e922995947151"
server_key_iv: "c28e45ec0b0d6038b1318df7c95b96db"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.049633 5053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "96d8959fd20642988f5c20b88e106102"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "c6e2894881700186d02e922995947151"
server_key_iv: "c28e45ec0b0d6038b1318df7c95b96db"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.050869 5053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:16:09.051514 5076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.051689 5053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.051796 5053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "96d8959fd20642988f5c20b88e106102"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "c6e2894881700186d02e922995947151"
server_key_iv: "c28e45ec0b0d6038b1318df7c95b96db"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.051851 5053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:09.071982 5053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:09.073737 5053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:09.073870 5053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:09.074066 5053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:09.074338 5053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:09.074376 5053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.074397 5053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:09.074414 5053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.079795 5053 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:39657
I20260809 16:16:09.079866 5274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:39657 every 8 connection(s)
I20260809 16:16:09.080145 5053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:09.081085 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 5053
I20260809 16:16:09.081187 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:09.081393 28516 external_mini_cluster.cc:1428] Setting key ecc8a362ab5a2bacfa04b803bfbe5b7b
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:09.089718 5010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.080857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:55145 (local address 127.27.217.62:39049)
0809 16:16:09.080948 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.080951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.081131 (+ 180us) server_negotiation.cc:407] Connection header received
0809 16:16:09.082329 (+ 1198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.082329 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.082341 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.082375 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.083138 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.083623 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.084598 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.084816 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.084871 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.087028 (+ 2157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:09.087029 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:09.087030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:09.087040 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:09.088494 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.088848 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.088849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.088850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.088912 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.089102 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.089102 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.089103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.089239 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:09.089310 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:09.089526 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 16:16:09.089624 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 16:16:09.089768 5278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.080831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:39049 (local address 127.27.217.1:55145)
0809 16:16:09.080994 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:09.081042 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:09.082220 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:09.082452 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:09.082456 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:09.082788 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:09.083061 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:09.083068 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.083726 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.083727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:09.084519 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:09.084521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.084886 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.084887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:09.085029 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.085461 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:09.085470 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:09.086937 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:09.088566 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:09.088572 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:09.088574 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:09.088781 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:09.088966 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:09.088967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:09.088967 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:09.089052 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:09.089295 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:09.089298 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:09.089401 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 16:16:09.089486 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 16:16:09.089601 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260809 16:16:09.090330 5275 heartbeater.cc:347] Connected to a master server at 127.27.217.62:39049
I20260809 16:16:09.090432 5275 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:09.090595 5275 heartbeater.cc:511] Master 127.27.217.62:39049 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
I20260809 16:16:09.091101 4951 ts_manager.cc:194] Registered new tserver with Master: 96d8959fd20642988f5c20b88e106102 (127.27.217.1:39657)
I20260809 16:16:09.091754 4951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:55145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:16:09.106329 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39049
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:36801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:09.185868 5284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:09.186072 5284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:09.186102 5284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:09.187243 5284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:09.187295 5284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:09.187330 5284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:09.188807 5284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:36801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:09.188994 5284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:09.189159 5284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:09.193750 5295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:09.193737 5293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:09.193733 5299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:09.193905 5284 server_base.cc:1034] running on GCE node
I20260809 16:16:09.194178 5284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:09.194381 5284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:09.195531 5284 hybrid_clock.cc:648] HybridClock initialized: now 1786292169195517 us; error 31 us; skew 500 ppm
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.198099 5284 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:16:09.198547 5284 webserver.cc:460] Webserver started at http://127.27.217.2:41905/ using document root <none> and password file <none>
I20260809 16:16:09.198755 5284 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:09.198804 5284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:09.198930 5284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:09.199952 5284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "906ccc1277c2498a9e03dc7b8fe5f6ef"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "3c3c2a2ce13f623bfb6b865c0ab5450b"
server_key_iv: "44299fa88b392f3c701c8b6a7ed4950c"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.200274 5284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "906ccc1277c2498a9e03dc7b8fe5f6ef"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "3c3c2a2ce13f623bfb6b865c0ab5450b"
server_key_iv: "44299fa88b392f3c701c8b6a7ed4950c"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.201496 5284 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:09.202227 5307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.202430 5284 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:09.202538 5284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "906ccc1277c2498a9e03dc7b8fe5f6ef"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "3c3c2a2ce13f623bfb6b865c0ab5450b"
server_key_iv: "44299fa88b392f3c701c8b6a7ed4950c"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.202598 5284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:09.209995 5284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:09.211735 5284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:09.211874 5284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:09.212083 5284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:09.212383 5284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:09.212416 5284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.212445 5284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:09.212462 5284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.218003 5284 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:46409
I20260809 16:16:09.218043 5498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:46409 every 8 connection(s)
I20260809 16:16:09.218346 5284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:16:09.220822 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 5284
I20260809 16:16:09.220938 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:09.221122 28516 external_mini_cluster.cc:1428] Setting key 16160006cb154811d141ac76209f6f21
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:09.227694 5010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.219005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:49309 (local address 127.27.217.62:39049)
0809 16:16:09.219057 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.219059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.219251 (+ 192us) server_negotiation.cc:407] Connection header received
0809 16:16:09.220210 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.220211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.220224 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.220290 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.221031 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.221587 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.222585 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.222801 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.222858 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.225161 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:09.225163 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:09.225163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:09.225170 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:09.226417 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.226791 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.226793 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.226793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.226850 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.227067 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.227067 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.227068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.227175 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:09.227232 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:09.227488 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 16:16:09.227582 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:16:09.227881 5503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.218974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:39049 (local address 127.27.217.2:49309)
0809 16:16:09.219129 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:09.219170 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:09.220108 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:09.220350 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:09.220353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:09.220611 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:09.220907 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:09.220914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.221690 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.221691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:09.222494 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:09.222497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.222873 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.222874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:09.222993 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.223483 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:09.223495 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:09.225067 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:09.226495 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:09.226502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:09.226504 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:09.226725 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:09.226905 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:09.226906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:09.226906 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:09.227012 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:09.227233 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:09.227239 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:09.227372 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 16:16:09.227459 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 16:16:09.227615 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":71,"threads_started":1}
I20260809 16:16:09.228313 5500 heartbeater.cc:347] Connected to a master server at 127.27.217.62:39049
I20260809 16:16:09.228401 5500 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:09.228570 5500 heartbeater.cc:511] Master 127.27.217.62:39049 requested a full tablet report, sending...
I20260809 16:16:09.228946 4951 ts_manager.cc:194] Registered new tserver with Master: 906ccc1277c2498a9e03dc7b8fe5f6ef (127.27.217.2:46409)
I20260809 16:16:09.229431 4951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:49309
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:16:09.245949 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39049
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:36801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:09.325719 5509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:09.325907 5509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:09.325928 5509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:09.326987 5509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:09.327020 5509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:09.327044 5509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:09.328528 5509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:36801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:09.328707 5509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:09.328877 5509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:09.333523 5520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:09.333539 5515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:09.333539 5517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:09.333765 5509 server_base.cc:1034] running on GCE node
I20260809 16:16:09.333954 5509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:09.334144 5509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:09.335273 5509 hybrid_clock.cc:648] HybridClock initialized: now 1786292169335259 us; error 30 us; skew 500 ppm
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.337680 5509 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:16:09.338092 5509 webserver.cc:460] Webserver started at http://127.27.217.3:38859/ using document root <none> and password file <none>
I20260809 16:16:09.338275 5509 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:09.338313 5509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:09.338397 5509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:09.339329 5509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "7a6aa46b96354655b7a7b8757a060162"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "01b1e5eb2e33827c59008e2e6c1fdcf8"
server_key_iv: "b25ba626aed97c6b1b7c46185218c2d9"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.339622 5509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "7a6aa46b96354655b7a7b8757a060162"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "01b1e5eb2e33827c59008e2e6c1fdcf8"
server_key_iv: "b25ba626aed97c6b1b7c46185218c2d9"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.340981 5509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:09.341639 5532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.341845 5509 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:09.341938 5509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "7a6aa46b96354655b7a7b8757a060162"
format_stamp: "Formatted at 2026-08-09 16:16:09 on dist-test-slave-nj21"
server_key: "01b1e5eb2e33827c59008e2e6c1fdcf8"
server_key_iv: "b25ba626aed97c6b1b7c46185218c2d9"
server_key_version: "encryptionkey@0"
I20260809 16:16:09.341995 5509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:09.355425 5509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:09.357363 5509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:09.357489 5509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:09.357697 5509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:09.357975 5509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:09.358009 5509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.358037 5509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:09.358062 5509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:09.363727 5509 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:46343
I20260809 16:16:09.363790 5731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:46343 every 8 connection(s)
I20260809 16:16:09.364068 5509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:09.370493 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 5509
I20260809 16:16:09.370570 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:09.370729 28516 external_mini_cluster.cc:1428] Setting key 2b9bcfc10419a856732aa4044635f6d2
I20260809 16:16:09.372824 5010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.364783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:36437 (local address 127.27.217.62:39049)
0809 16:16:09.364842 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.364844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.365005 (+ 161us) server_negotiation.cc:407] Connection header received
0809 16:16:09.365912 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.365913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.365925 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.365993 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.366571 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.367077 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.368053 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.368246 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.368307 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.370241 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:09.370242 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:09.370243 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:09.370257 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:09.371658 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.372092 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.372094 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.372094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.372148 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.372340 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.372341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.372341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.372447 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:09.372497 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:09.372693 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 16:16:09.372753 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:16:09.372957 5738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.364726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:39049 (local address 127.27.217.3:36437)
0809 16:16:09.364884 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:09.364925 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:09.365811 (+ 886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:09.366044 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:09.366047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:09.366289 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:09.366467 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:09.366470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.367143 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.367144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:09.367976 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:09.367979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.368350 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.368352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:09.368460 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.368850 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:09.368858 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:09.370148 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:09.371764 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:09.371771 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:09.371773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:09.371998 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:09.372201 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:09.372202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:09.372202 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:09.372294 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:09.372492 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:09.372495 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:09.372600 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 16:16:09.372675 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 16:16:09.372792 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260809 16:16:09.373383 5733 heartbeater.cc:347] Connected to a master server at 127.27.217.62:39049
I20260809 16:16:09.373463 5733 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:09.373601 5733 heartbeater.cc:511] Master 127.27.217.62:39049 requested a full tablet report, sending...
I20260809 16:16:09.373926 4951 ts_manager.cc:194] Registered new tserver with Master: 7a6aa46b96354655b7a7b8757a060162 (127.27.217.3:46343)
I20260809 16:16:09.374253 4951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:36437
I20260809 16:16:09.382509 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/test-admin.keytab.
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.397524 28516 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 16:16:09.399081 5745 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:09.398378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49546 (local address 127.27.217.1:39657)
0809 16:16:09.398565 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.398570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.398581 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:16:09.398606 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.398608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.398621 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.398685 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.399009 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49546: BlockingRecv error: recv got EOF from 127.0.0.1:49546 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":105,"threads_started":1}
W20260809 16:16:09.399260 28516 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5cc' of type FILE
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.400238 28516 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.401098 28516 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:16:09.408277 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.401582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49560 (local address 127.27.217.1:39657)
0809 16:16:09.401620 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.401622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.401667 (+ 45us) server_negotiation.cc:407] Connection header received
0809 16:16:09.401708 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.401709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.401719 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.401760 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.402102 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.402829 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.403479 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.403833 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.403886 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.405905 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:09.405913 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:09.405913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:09.405920 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:09.407324 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.407615 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.407617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.407617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.407689 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.407842 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.407843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.407843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.407970 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:09.408067 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:09.408116 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 16:16:09.408173 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 16:16:09.409899 5745 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:09.409458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49566 (local address 127.27.217.1:39657)
0809 16:16:09.409494 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.409495 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.409505 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:09.409551 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.409551 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.409559 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.409599 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.409860 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49566: BlockingRecv error: recv got EOF from 127.0.0.1:49566 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 16:16:09.410004 28516 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5cc' of type FILE
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.410881 28516 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.411644 28516 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:16:09.417512 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.412139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49568 (local address 127.27.217.1:39657)
0809 16:16:09.412185 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.412186 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.412197 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:16:09.412245 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.412245 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.412253 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.412290 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.412591 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.413057 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.413661 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.413837 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.413878 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.415632 (+ 1754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:09.415633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:09.415633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:09.415638 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:09.416663 (+ 1025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.416953 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.416954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.416954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.417007 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.417143 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.417143 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.417144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.417223 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:09.417288 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:09.417366 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 16:16:09.417429 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260809 16:16:09.418737 5745 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:09.418357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49570 (local address 127.27.217.1:39657)
0809 16:16:09.418400 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.418401 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.418425 (+ 24us) server_negotiation.cc:407] Connection header received
0809 16:16:09.418471 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.418472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.418478 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.418520 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.418707 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49570: BlockingRecv error: recv got EOF from 127.0.0.1:49570 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260809 16:16:09.418860 28516 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786292143139430-28516-0/krb5kdc/krb5cc' of type FILE
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.419763 28516 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:09.420625 28516 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[4873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:16:09.426403 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:09.421049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49572 (local address 127.27.217.1:39657)
0809 16:16:09.421093 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:09.421094 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:09.421105 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:16:09.421163 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:09.421164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:09.421170 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:09.421205 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:09.421487 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.421907 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.422496 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:09.422665 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:09.422704 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:09.424647 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:09.424649 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:09.424649 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:09.424656 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:09.425643 (+ 987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.425915 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.425915 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.425915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.425957 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:09.426066 (+ 109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:09.426066 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:09.426067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:09.426138 (+ 71us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:09.426196 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:09.426272 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 16:16:09.426320 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 16:16:09.427016 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 5053
I20260809 16:16:09.438887 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 5284
I20260809 16:16:09.466562 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 5509
I20260809 16:16:09.482529 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 4900
2026-08-09T16:16:09Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1980 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[5768](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[5768](info): set up 2 sockets
Aug 09 16:16:09 dist-test-slave-nj21 krb5kdc[5768](info): commencing operation
krb5kdc: starting...
W20260809 16:16:10.625888 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:10 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:10Z Disabled control of system clock
WARNING: no policy specified for oryx/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.62.keytab.
Entry for principal oryx/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.62.keytab.
I20260809 16:16:10.738435 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41665
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.62.keytab
--principal=oryx/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:10.817153 5787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:10.817339 5787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:10.817368 5787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:10.818455 5787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:10.818493 5787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:10.818512 5787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:10.818527 5787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:10.818542 5787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:10.820003 5787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.62.keytab
--principal=oryx/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:10.820228 5787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:10.820422 5787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:10.824805 5795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:10.824819 5802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:10.824841 5796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:10.824891 5787 server_base.cc:1034] running on GCE node
I20260809 16:16:10.825255 5787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:10.825515 5787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:10.826746 5787 hybrid_clock.cc:648] HybridClock initialized: now 1786292170826724 us; error 31 us; skew 500 ppm
Aug 09 16:16:10 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292170, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:10.836367 5787 init.cc:377] Logged in from keytab as oryx/127.27.217.62@KRBTEST.COM (short username oryx)
I20260809 16:16:10.836833 5787 webserver.cc:460] Webserver started at http://127.27.217.62:42581/ using document root <none> and password file <none>
I20260809 16:16:10.837038 5787 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:10.837090 5787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:10.837229 5787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:10.838280 5787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "2b770a5f127d453d8f1ca4ef69319018"
format_stamp: "Formatted at 2026-08-09 16:16:10 on dist-test-slave-nj21"
server_key: "f9b064e9f8ee496bab7f82fccb9250df"
server_key_iv: "a4619112ac90c10ef350396b20278d0f"
server_key_version: "encryptionkey@0"
I20260809 16:16:10.838634 5787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "2b770a5f127d453d8f1ca4ef69319018"
format_stamp: "Formatted at 2026-08-09 16:16:10 on dist-test-slave-nj21"
server_key: "f9b064e9f8ee496bab7f82fccb9250df"
server_key_iv: "a4619112ac90c10ef350396b20278d0f"
server_key_version: "encryptionkey@0"
I20260809 16:16:10.839956 5787 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:16:10.840632 5815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:10.840796 5787 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:10.840890 5787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "2b770a5f127d453d8f1ca4ef69319018"
format_stamp: "Formatted at 2026-08-09 16:16:10 on dist-test-slave-nj21"
server_key: "f9b064e9f8ee496bab7f82fccb9250df"
server_key_iv: "a4619112ac90c10ef350396b20278d0f"
server_key_version: "encryptionkey@0"
I20260809 16:16:10.840952 5787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:10.860478 5787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:10.862679 5787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:10.862834 5787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:10.866969 5787 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:41665
I20260809 16:16:10.867003 5907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:41665 every 8 connection(s)
I20260809 16:16:10.867355 5787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:10.868320 5908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:10.870522 5908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: Bootstrap starting.
I20260809 16:16:10.871049 5908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:10.871269 5908 log.cc:824] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:10.871953 5908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: No bootstrap required, opened a new log
I20260809 16:16:10.872826 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 5787
I20260809 16:16:10.872926 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:10.873095 28516 external_mini_cluster.cc:1428] Setting key d39a4ec3d2c463418155a8d6e1b87af5
I20260809 16:16:10.873649 5908 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } }
I20260809 16:16:10.873808 5908 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:10.873847 5908 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b770a5f127d453d8f1ca4ef69319018, State: Initialized, Role: FOLLOWER
I20260809 16:16:10.873971 5908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } }
I20260809 16:16:10.874051 5908 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:10.874081 5908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:10.874128 5908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:10.875080 5908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } }
I20260809 16:16:10.875167 5908 leader_election.cc:302] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b770a5f127d453d8f1ca4ef69319018; no voters:
I20260809 16:16:10.875311 5908 leader_election.cc:288] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:10.875353 5917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:10.875488 5917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 1 LEADER]: Becoming Leader. State: Replica: 2b770a5f127d453d8f1ca4ef69319018, State: Running, Role: LEADER
I20260809 16:16:10.875560 5908 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:10.875573 5917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } }
I20260809 16:16:10.875910 5917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b770a5f127d453d8f1ca4ef69319018. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } }
I20260809 16:16:10.875982 5917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:10.876151 5918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } }
I20260809 16:16:10.876176 5925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:10.876205 5918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:10.876633 5925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:10.878536 5925 catalog_manager.cc:1347] Generated new cluster ID: 3d0e61d153e2458d8bfbee767b8cbfa8
I20260809 16:16:10.878587 5925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:16:10 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:10.883932 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:10.873579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56974 (local address 127.27.217.62:41665)
0809 16:16:10.873730 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:10.873737 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:10.873765 (+ 28us) server_negotiation.cc:407] Connection header received
0809 16:16:10.873853 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:10.873860 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:10.873914 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:10.874028 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:10.874788 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:10.875964 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:10.877026 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:10.877614 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:10.877729 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:10.880392 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:10.880396 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:10.880397 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:10.880409 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:10.882308 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:10.882663 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:10.882666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:10.882666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:10.882801 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:10.882983 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:10.882984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:10.882984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:10.883328 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:10.883487 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:10.883556 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 16:16:10.883731 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260809 16:16:10.895017 5925 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:10.895511 5925 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:10.899425 5925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: Generated new TSK 0
I20260809 16:16:10.899585 5925 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab.
Entry for principal oryx/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab.
I20260809 16:16:10.928339 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41665
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab
--principal=oryx/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:11.037703 5948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:11.037906 5948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:11.037937 5948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:11.039116 5948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:11.039158 5948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:11.039192 5948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:11.040925 5948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab
--principal=oryx/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:11.041168 5948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:11.041388 5948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:11.046461 5955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.046497 5957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.046505 5960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.046665 5948 server_base.cc:1034] running on GCE node
I20260809 16:16:11.046838 5948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:11.047047 5948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:11.048178 5948 hybrid_clock.cc:648] HybridClock initialized: now 1786292171048156 us; error 35 us; skew 500 ppm
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:11.050680 5948 init.cc:377] Logged in from keytab as oryx/127.27.217.1@KRBTEST.COM (short username oryx)
I20260809 16:16:11.051110 5948 webserver.cc:460] Webserver started at http://127.27.217.1:43013/ using document root <none> and password file <none>
I20260809 16:16:11.051339 5948 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.051393 5948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.051528 5948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:11.052599 5948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "42d3859f811f4e8a9b684359edcf26cf"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7c67a0352e259e369da3dace6a90631a"
server_key_iv: "e8b4cc235945ffec667c28bdcaf24ddf"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.052953 5948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "42d3859f811f4e8a9b684359edcf26cf"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7c67a0352e259e369da3dace6a90631a"
server_key_iv: "e8b4cc235945ffec667c28bdcaf24ddf"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.054237 5948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:11.054865 5974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.055022 5948 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:11.055107 5948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "42d3859f811f4e8a9b684359edcf26cf"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7c67a0352e259e369da3dace6a90631a"
server_key_iv: "e8b4cc235945ffec667c28bdcaf24ddf"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.055181 5948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.075819 5948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:11.077803 5948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:11.077926 5948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:11.078152 5948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:11.078462 5948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:11.078496 5948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.078517 5948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:11.078540 5948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.083993 5948 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:34137
I20260809 16:16:11.084061 6165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:34137 every 8 connection(s)
I20260809 16:16:11.084345 5948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:11.092842 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.085072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:55813 (local address 127.27.217.62:41665)
0809 16:16:11.085150 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.085152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.085295 (+ 143us) server_negotiation.cc:407] Connection header received
0809 16:16:11.085779 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.085780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.085791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.085856 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.086774 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.087275 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.088266 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.088468 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.088514 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.090503 (+ 1989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.090504 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.090505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.090512 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.091725 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.092063 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.092064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.092064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.092114 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.092317 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.092318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.092319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.092439 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.092503 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.092699 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.092774 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 16:16:11.092985 6169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.084982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:55813)
0809 16:16:11.085150 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.085191 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.085671 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.085918 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.085922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.086492 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.086684 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.086690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.087366 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.087367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.088189 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.088191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.088523 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.088523 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.088617 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.089089 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.089097 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.090400 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.091787 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.091792 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.091794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.092004 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.092155 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.092155 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.092156 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.092242 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.092497 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.092499 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.092605 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.092679 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.092790 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260809 16:16:11.093464 6166 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41665
I20260809 16:16:11.093554 6166 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:11.093624 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 5948
I20260809 16:16:11.093720 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:11.093731 6166 heartbeater.cc:511] Master 127.27.217.62:41665 requested a full tablet report, sending...
I20260809 16:16:11.093961 28516 external_mini_cluster.cc:1428] Setting key 564d8a1f040fb41cb789f0e440ba4930
I20260809 16:16:11.094298 5847 ts_manager.cc:194] Registered new tserver with Master: 42d3859f811f4e8a9b684359edcf26cf (127.27.217.1:34137)
I20260809 16:16:11.095036 5847 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:55813
WARNING: no policy specified for oryx/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab.
Entry for principal oryx/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab.
I20260809 16:16:11.119309 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41665
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab
--principal=oryx/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:11.201181 6179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:11.201365 6179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:11.201386 6179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:11.202437 6179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:11.202468 6179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:11.202492 6179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:11.203891 6179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab
--principal=oryx/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:11.204077 6179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:11.204244 6179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:11.211826 6187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.211922 6189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.211951 6179 server_base.cc:1034] running on GCE node
W20260809 16:16:11.211823 6186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.212294 6179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:11.212522 6179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:11.213661 6179 hybrid_clock.cc:648] HybridClock initialized: now 1786292171213650 us; error 29 us; skew 500 ppm
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:11.216223 6179 init.cc:377] Logged in from keytab as oryx/127.27.217.2@KRBTEST.COM (short username oryx)
I20260809 16:16:11.216641 6179 webserver.cc:460] Webserver started at http://127.27.217.2:40241/ using document root <none> and password file <none>
I20260809 16:16:11.216861 6179 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.216907 6179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.217025 6179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:11.217984 6179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "939121d7035044a89ec3c1f0fe8f9d02"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "8bc853853ef3234428482207eb01beae"
server_key_iv: "5857fd306d0cc6e481a9df4dbbbc3be1"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.218302 6179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "939121d7035044a89ec3c1f0fe8f9d02"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "8bc853853ef3234428482207eb01beae"
server_key_iv: "5857fd306d0cc6e481a9df4dbbbc3be1"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.219550 6179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:16:11.220292 6197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.220445 6179 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.220527 6179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "939121d7035044a89ec3c1f0fe8f9d02"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "8bc853853ef3234428482207eb01beae"
server_key_iv: "5857fd306d0cc6e481a9df4dbbbc3be1"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.220592 6179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.227509 6179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:11.229527 6179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:11.229657 6179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:11.229846 6179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:11.230108 6179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:11.230139 6179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.230165 6179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:11.230190 6179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.235742 6179 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:45051
I20260809 16:16:11.235798 6409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:45051 every 8 connection(s)
I20260809 16:16:11.236068 6179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:11.245117 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.236701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:33161 (local address 127.27.217.62:41665)
0809 16:16:11.236755 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.236757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.236942 (+ 185us) server_negotiation.cc:407] Connection header received
0809 16:16:11.237442 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.237443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.237457 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.237506 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.238385 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.238894 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.239904 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.240115 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.240171 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.242453 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.242455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.242455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.242461 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.243697 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.244187 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.244188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.244188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.244262 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.244508 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.244509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.244509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.244608 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.244653 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.244975 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.245053 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 16:16:11.245326 6414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.236685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:33161)
0809 16:16:11.236830 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.236863 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.237345 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.237572 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.237576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.238114 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.238292 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.238296 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.238990 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.238991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.239823 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.239825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.240183 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.240184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.240307 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.240775 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.240783 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.242362 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.243765 (+ 1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.243772 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.243775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.244108 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.244321 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.244322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.244323 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.244451 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.244675 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.244680 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.244833 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.244944 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.245108 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
I20260809 16:16:11.245839 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 6179
I20260809 16:16:11.245944 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:11.245947 6412 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41665
I20260809 16:16:11.246027 6412 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:11.246150 28516 external_mini_cluster.cc:1428] Setting key a1e279af14d9096e0262082dc12b9484
I20260809 16:16:11.246208 6412 heartbeater.cc:511] Master 127.27.217.62:41665 requested a full tablet report, sending...
I20260809 16:16:11.246574 5845 ts_manager.cc:194] Registered new tserver with Master: 939121d7035044a89ec3c1f0fe8f9d02 (127.27.217.2:45051)
I20260809 16:16:11.247084 5845 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:33161
WARNING: no policy specified for oryx/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab.
Entry for principal oryx/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab.
I20260809 16:16:11.272348 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41665
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab
--principal=oryx/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:11.352447 6419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:11.352632 6419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:11.352653 6419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:11.353744 6419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:11.353782 6419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:11.353811 6419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:11.355218 6419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab
--principal=oryx/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:11.355432 6419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:11.355629 6419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:11.360365 6427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.360380 6432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.360375 6428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.360605 6419 server_base.cc:1034] running on GCE node
I20260809 16:16:11.360777 6419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:11.360981 6419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:11.362109 6419 hybrid_clock.cc:648] HybridClock initialized: now 1786292171362095 us; error 26 us; skew 500 ppm
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:11.364569 6419 init.cc:377] Logged in from keytab as oryx/127.27.217.3@KRBTEST.COM (short username oryx)
I20260809 16:16:11.364931 6419 webserver.cc:460] Webserver started at http://127.27.217.3:37039/ using document root <none> and password file <none>
I20260809 16:16:11.365110 6419 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.365147 6419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.365233 6419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:11.366178 6419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "77a681bf85ba45da8db182bf3c0e4d3a"
server_key_iv: "75974609a8afd65b7663567187293485"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.366520 6419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "77a681bf85ba45da8db182bf3c0e4d3a"
server_key_iv: "75974609a8afd65b7663567187293485"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.367635 6419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:11.368297 6443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.368438 6419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:11.368520 6419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "77a681bf85ba45da8db182bf3c0e4d3a"
server_key_iv: "75974609a8afd65b7663567187293485"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.368577 6419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.387084 6419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:11.389084 6419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:11.389210 6419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:11.389400 6419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:11.389674 6419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:11.389707 6419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.389734 6419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:11.389760 6419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.395251 6419 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:45789
I20260809 16:16:11.395404 6624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:45789 every 8 connection(s)
I20260809 16:16:11.395594 6419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:11.397339 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 6419
I20260809 16:16:11.397426 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:11.397583 28516 external_mini_cluster.cc:1428] Setting key 5d8cab95af906ff0a79ba89516246710
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:11.404057 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.396240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:49133 (local address 127.27.217.62:41665)
0809 16:16:11.396281 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.396283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.396469 (+ 186us) server_negotiation.cc:407] Connection header received
0809 16:16:11.396956 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.396958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.396971 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.397023 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.398045 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.398625 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.399603 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.399874 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.399931 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.401783 (+ 1852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.401784 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.401785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.401801 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.402837 (+ 1036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.403175 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.403176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.403177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.403229 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.403441 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.403442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.403442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.403551 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.403607 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.403890 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.403970 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:16:11.404206 6627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.396209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:49133)
0809 16:16:11.396358 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.396392 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.396863 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.397090 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.397094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.397722 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.397975 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.397982 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.398707 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.398708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.399523 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.399526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.399941 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.399942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.400067 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.400442 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.400450 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.401703 (+ 1253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.402905 (+ 1202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.402911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.402913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.403112 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.403280 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.403281 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.403281 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.403386 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.403603 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.403609 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.403770 (+ 161us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.403859 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.404003 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
I20260809 16:16:11.404611 6625 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41665
I20260809 16:16:11.404699 6625 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:11.404858 6625 heartbeater.cc:511] Master 127.27.217.62:41665 requested a full tablet report, sending...
I20260809 16:16:11.405187 5845 ts_manager.cc:194] Registered new tserver with Master: ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789)
I20260809 16:16:11.405565 5845 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:49133
I20260809 16:16:11.409126 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.27.217.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.61.keytab.
Entry for principal oryx/127.27.217.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.61.keytab.
I20260809 16:16:11.432129 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.61:35753
--webserver_interface=127.27.217.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.61.keytab
--principal=oryx/127.27.217.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41665,127.27.217.61:35753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:11.510738 6631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:11.510927 6631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:11.510947 6631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:11.512053 6631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:11.512091 6631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:11.512104 6631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:11.512115 6631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:11.512130 6631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:11.513530 6631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41665,127.27.217.61:35753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.61.keytab
--principal=oryx/127.27.217.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.61:35753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.217.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
W20260809 16:16:11.513623 6631 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.27.217.62:41665,127.27.217.61:35753'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 16:16:11.513721 6631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:11.513882 6631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:11.518252 6638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.518296 6640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.518296 6642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.518465 6631 server_base.cc:1034] running on GCE node
I20260809 16:16:11.518671 6631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:11.518954 6631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:11.520098 6631 hybrid_clock.cc:648] HybridClock initialized: now 1786292171520079 us; error 33 us; skew 500 ppm
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:11.522717 6631 init.cc:377] Logged in from keytab as oryx/127.27.217.61@KRBTEST.COM (short username oryx)
I20260809 16:16:11.523121 6631 webserver.cc:460] Webserver started at http://127.27.217.61:36685/ using document root <none> and password file <none>
I20260809 16:16:11.523332 6631 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.523391 6631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.523515 6631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:11.524524 6631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data/instance:
uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "ab0353c4ac82c03250036614536dde33"
server_key_iv: "4a77d9e1946fb3f287c85ef76b078512"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.524863 6631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal/instance:
uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "ab0353c4ac82c03250036614536dde33"
server_key_iv: "4a77d9e1946fb3f287c85ef76b078512"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.526119 6631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:11.526778 6655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.526959 6631 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:11.527043 6631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "ab0353c4ac82c03250036614536dde33"
server_key_iv: "4a77d9e1946fb3f287c85ef76b078512"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.527101 6631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.552935 6631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:11.554911 6631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:11.555042 6631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:11.559065 6631 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.61:35753
I20260809 16:16:11.559118 6738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.61:35753 every 8 connection(s)
I20260809 16:16:11.559410 6631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
I20260809 16:16:11.560351 6740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:11.561820 6740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:16:11.566479 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 6631
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.61@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:11.570153 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.562491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56978 (local address 127.27.217.62:41665)
0809 16:16:11.562535 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.562537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.562718 (+ 181us) server_negotiation.cc:407] Connection header received
0809 16:16:11.563144 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.563144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.563154 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.563199 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.563762 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.564239 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.565312 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.565515 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.565567 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.567592 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.567594 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.567594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.567603 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.568899 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.569252 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.569253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.569254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.569307 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.569524 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.569525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.569525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.569675 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.569734 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.569983 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.570064 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:16:11.570283 6747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.562457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:56978)
0809 16:16:11.562608 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.562640 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.563071 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.563255 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.563258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.563486 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.563664 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.563700 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.564334 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.564336 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.565242 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.565245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.565575 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.565576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.565667 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.566045 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.566052 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.567512 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.568976 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.568983 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.568985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.569187 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.569360 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.569360 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.569361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.569469 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.569734 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.569740 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.569868 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.569952 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.570086 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260809 16:16:11.570905 6740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.217.61@KRBTEST.COM
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.61@KRBTEST.COM for oryx/127.27.217.61@KRBTEST.COM
I20260809 16:16:11.574937 6751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.566949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35920 (local address 127.27.217.61:35753)
0809 16:16:11.567080 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.567084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.567228 (+ 144us) server_negotiation.cc:407] Connection header received
0809 16:16:11.567272 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.567275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.567296 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.567357 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.568025 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.568674 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.569392 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.569686 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.569744 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.572363 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.572381 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.572381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.572387 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.573876 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.574171 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.574174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.574174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.574236 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.574399 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.574400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.574400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.574546 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.574700 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.574771 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.574840 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
I20260809 16:16:11.577383 6747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.571157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.0.0.1:35928)
0809 16:16:11.571183 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.571191 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.571223 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.571459 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.571460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.571561 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.571606 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.571607 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.572393 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.572394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.572845 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.572846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.573164 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.573165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.573224 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.573528 (+ 304us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.573531 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.574682 (+ 1151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.576630 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.576631 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.576631 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.576778 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.576916 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.576917 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.576917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.576960 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.577171 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.577172 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.577206 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.577254 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.577324 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260809 16:16:11.577486 6754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.571189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35928 (local address 127.27.217.61:35753)
0809 16:16:11.571355 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.571356 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.571363 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:16:11.571379 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.571380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.571388 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.571453 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.571683 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.572320 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.572905 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.573112 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.573162 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.574749 (+ 1587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.574750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.574750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.574756 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.576566 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.576834 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.576834 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.576834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.576875 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.576992 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.576993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.576993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.577108 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.577178 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.577271 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.577369 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":147,"thread_start_us":102,"threads_started":1}
I20260809 16:16:11.578599 6740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Bootstrap starting.
I20260809 16:16:11.579154 6740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:11.579370 6740 log.cc:824] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:11.580075 6740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: No bootstrap required, opened a new log
I20260809 16:16:11.581462 6740 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } }
I20260809 16:16:11.581578 6740 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:11.581605 6740 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c72c0139d6140d9b4f4ecbe2c5adaef, State: Initialized, Role: FOLLOWER
I20260809 16:16:11.581694 6740 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } }
I20260809 16:16:11.581943 6740 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:11.581905 6757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } } }
I20260809 16:16:11.581987 6757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: This master's current role is: FOLLOWER
W20260809 16:16:11.583462 6778 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:16:11.583523 6778 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:16:11.584936 6757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:11.585008 6757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } }
I20260809 16:16:11.585139 6631 master_runner.cc:428] Detected that this master 8c72c0139d6140d9b4f4ecbe2c5adaef is joining an existing cluster
I20260809 16:16:11.585180 6757 leader_election.cc:288] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665)
I20260809 16:16:11.585223 6631 master_runner.cc:432] Initiating AddMaster RPC to add 127.27.217.61:35753
I20260809 16:16:11.585425 5867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b770a5f127d453d8f1ca4ef69319018" is_pre_election: true
I20260809 16:16:11.585778 6656 leader_election.cc:302] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 8c72c0139d6140d9b4f4ecbe2c5adaef; no voters: 2b770a5f127d453d8f1ca4ef69319018
I20260809 16:16:11.585896 6757 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 16:16:11.592228 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.586418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56990 (local address 127.27.217.62:41665)
0809 16:16:11.586460 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.586461 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.586483 (+ 22us) server_negotiation.cc:407] Connection header received
0809 16:16:11.586503 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.586503 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.586512 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.586553 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.586849 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.587334 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.588190 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.588440 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.588501 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.589462 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.589464 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.589464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.589471 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.590897 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.591256 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.591256 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.591257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.591305 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.591487 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.591488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.591488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.591595 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.591648 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.591829 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.591917 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:16:11.592789 6787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.586221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:56990)
0809 16:16:11.586392 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.586403 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.586454 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.586556 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.586557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.586716 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.586781 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.586783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.587407 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.587408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.588122 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.588124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.588571 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.588572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.588644 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.589086 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.589090 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.589371 (+ 281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.590958 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.590959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.590959 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.591173 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.591371 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.591372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.591373 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.591434 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.591649 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.591650 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.591710 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.592349 (+ 639us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.592683 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260809 16:16:11.594412 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.586230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.0.0.1:35934)
0809 16:16:11.587811 (+ 1581us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.587823 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.587884 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.588009 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.588009 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.588186 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.588247 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.588249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.589013 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.589014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.589873 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.589876 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.590557 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.590558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.590632 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.591303 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.591307 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.591658 (+ 351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.593334 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.593334 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.593335 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.593544 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.593743 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.593744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.593744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.593798 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.594097 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.594097 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.594129 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.594190 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.594289 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1565,"spinlock_wait_cycles":9600,"thread_start_us":99,"threads_started":1}
I20260809 16:16:11.594568 6754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.586416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35934 (local address 127.27.217.61:35753)
0809 16:16:11.586450 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.586452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.587893 (+ 1441us) server_negotiation.cc:407] Connection header received
0809 16:16:11.587938 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.587939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.587948 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.588003 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.588318 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.588938 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.589971 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.590477 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.590539 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.591745 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.591746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.591747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.591753 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.593259 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.593622 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.593623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.593623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.593682 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.593885 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.593886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.593886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.594012 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.594075 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.594337 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.594415 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292170, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.62@KRBTEST.COM for oryx/127.27.217.61@KRBTEST.COM
I20260809 16:16:11.601270 6754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.595264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35950 (local address 127.27.217.61:35753)
0809 16:16:11.595298 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.595299 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.595307 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:11.595394 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.595394 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.595404 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.595454 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.595881 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.596309 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.597022 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.597213 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.597264 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.599018 (+ 1754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.599020 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.599020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.599026 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.600225 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.600574 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.600575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.600576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.600630 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.600801 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.600801 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.600802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.600905 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.600958 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.601116 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.601190 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:16:11.601297 6790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.595126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.0.0.1:35950)
0809 16:16:11.595224 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.595265 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.595325 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.595460 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.595464 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.595756 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.595806 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.595808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.596382 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.596383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.596947 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.596949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.597272 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.597273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.597381 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.597742 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.597746 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.598941 (+ 1195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.600297 (+ 1356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.600304 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.600306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.600508 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.600691 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.600692 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.600692 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.600749 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.600958 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.600965 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.601015 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.601084 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.601193 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":51,"threads_started":1}
I20260809 16:16:11.601754 5845 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.27.217.61:35753: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef"
member_type: NON_VOTER
last_known_addr {
host: "127.27.217.61"
port: 35753
}
attrs {
promote: true
}
}
dest_uuid: "2b770a5f127d453d8f1ca4ef69319018"
cas_config_opid_index: -1
I20260809 16:16:11.602080 5845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } }
I20260809 16:16:11.602543 6792 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 8c72c0139d6140d9b4f4ecbe2c5adaef (127.27.217.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } }
I20260809 16:16:11.602805 6695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:11.603328 6792 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.27.217.61:35753
I20260809 16:16:11.603605 6631 master.cc:537] Master@127.27.217.61:35753 shutting down...
I20260809 16:16:11.603597 6791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } }
I20260809 16:16:11.603705 6791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:11.603722 6695 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Refusing update from remote peer 2b770a5f127d453d8f1ca4ef69319018: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 16:16:11.604029 6791 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 16:16:11.604663 5822 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 16:16:11.605090 5822 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 -> Peer 8c72c0139d6140d9b4f4ecbe2c5adaef (127.27.217.61:35753): Couldn't send request to peer 8c72c0139d6140d9b4f4ecbe2c5adaef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 16:16:11.606130 6631 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:11.606207 6631 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:11.606252 6631 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: stopping tablet replica
I20260809 16:16:11.618763 6631 master.cc:552] Master@127.27.217.61:35753 shutdown complete.
I20260809 16:16:11.618803 6631 master_runner.cc:305] Clearing existing system tablet
I20260809 16:16:11.618912 6631 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.618952 6631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.619484 6631 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:11.619932 6797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.620059 6631 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.620112 6631 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.620137 6631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "ab0353c4ac82c03250036614536dde33"
server_key_iv: "4a77d9e1946fb3f287c85ef76b078512"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.620797 6631 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:11.622414 6631 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 16:16:11.622499 6631 log.cc:1196] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 16:16:11.622669 6631 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Deleting consensus metadata
I20260809 16:16:11.622774 6631 master_runner.cc:315] Copying system tablet from 127.27.217.62:41665
I20260809 16:16:11.623350 6631 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: tablet copy: Beginning tablet copy session from remote peer at address 127.27.217.62:41665
I20260809 16:16:11.629107 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.623738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57004 (local address 127.27.217.62:41665)
0809 16:16:11.623781 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.623783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.623840 (+ 57us) server_negotiation.cc:407] Connection header received
0809 16:16:11.623913 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.623913 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.623921 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.623966 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.624302 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.624771 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.625772 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.626012 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.626073 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.626915 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.626916 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.626917 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.626924 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.628144 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.628442 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.628443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.628443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.628498 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.628653 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.628654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.628655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.628758 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.628814 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.628950 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.629017 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:11.629129 6808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.623636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57004)
0809 16:16:11.623773 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.623784 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.623856 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.623973 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.623973 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.624164 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.624240 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.624242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.624837 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.624838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.625692 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.625694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.626074 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.626075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.626147 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.626554 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.626559 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.626836 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.628217 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.628218 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.628219 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.628382 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.628550 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.628551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.628551 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.628605 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.628811 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.628812 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.628854 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.628920 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.629019 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260809 16:16:11.629369 5884 tablet_copy_service.cc:140] P 2b770a5f127d453d8f1ca4ef69319018: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8c72c0139d6140d9b4f4ecbe2c5adaef ({username='oryx', principal='oryx/127.27.217.61@KRBTEST.COM'} at 127.0.0.1:57004)
I20260809 16:16:11.629427 5884 tablet_copy_service.cc:161] P 2b770a5f127d453d8f1ca4ef69319018: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8c72c0139d6140d9b4f4ecbe2c5adaef at {username='oryx', principal='oryx/127.27.217.61@KRBTEST.COM'} at 127.0.0.1:57004: session id = 8c72c0139d6140d9b4f4ecbe2c5adaef-00000000000000000000000000000000
I20260809 16:16:11.630025 5884 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 16:16:11.630549 6631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 16:16:11.631386 6631 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: tablet copy: Starting download of 0 data blocks...
I20260809 16:16:11.631502 6631 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: tablet copy: Starting download of 1 WAL segments...
I20260809 16:16:11.632319 6631 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 16:16:11.633039 5884 tablet_copy_service.cc:342] P 2b770a5f127d453d8f1ca4ef69319018: Request end of tablet copy session 8c72c0139d6140d9b4f4ecbe2c5adaef-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.27.217.61@KRBTEST.COM'} at 127.0.0.1:57004
I20260809 16:16:11.633090 5884 tablet_copy_service.cc:433] P 2b770a5f127d453d8f1ca4ef69319018: ending tablet copy session 8c72c0139d6140d9b4f4ecbe2c5adaef-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8c72c0139d6140d9b4f4ecbe2c5adaef
I20260809 16:16:11.635391 6631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:11.636427 6810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.636480 6815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.636611 6818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.636620 6631 server_base.cc:1034] running on GCE node
I20260809 16:16:11.636837 6631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:11.636968 6631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:11.638072 6631 hybrid_clock.cc:648] HybridClock initialized: now 1786292171638061 us; error 28 us; skew 500 ppm
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:11.639292 6631 init.cc:377] Logged in from keytab as oryx/127.27.217.61@KRBTEST.COM (short username oryx)
I20260809 16:16:11.639549 6631 webserver.cc:460] Webserver started at http://127.27.217.61:36445/ using document root <none> and password file <none>
I20260809 16:16:11.639653 6631 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.639710 6631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.640336 6631 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:11.640861 6827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.640985 6631 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:11.641028 6631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "ab0353c4ac82c03250036614536dde33"
server_key_iv: "4a77d9e1946fb3f287c85ef76b078512"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.641078 6631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.649051 6631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:11.650383 6631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:11.653244 6631 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.61:35753
I20260809 16:16:11.653545 6917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.61:35753 every 8 connection(s)
I20260809 16:16:11.653595 6631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
I20260809 16:16:11.654227 6919 sys_catalog.cc:263] Verifying existing consensus state
I20260809 16:16:11.654624 6919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Bootstrap starting.
I20260809 16:16:11.656733 6919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:16:11.656929 6919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Bootstrap complete.
I20260809 16:16:11.657101 6919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } }
I20260809 16:16:11.657166 6919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c72c0139d6140d9b4f4ecbe2c5adaef, State: Initialized, Role: LEARNER
I20260809 16:16:11.657191 6919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } }
I20260809 16:16:11.657341 6919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:11.657369 6923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } }
I20260809 16:16:11.657482 6923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: This master's current role is: LEARNER
I20260809 16:16:11.658758 6948 catalog_manager.cc:1259] Loaded cluster ID: 3d0e61d153e2458d8bfbee767b8cbfa8
I20260809 16:16:11.658799 6948 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: loading cluster ID for follower catalog manager: success
I20260809 16:16:11.659862 6948 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: acquiring CA information for follower catalog manager: success
I20260809 16:16:11.660120 6948 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 16:16:11.685927 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.676459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35970 (local address 127.27.217.61:35753)
0809 16:16:11.678060 (+ 1601us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.678062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.678072 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:11.678097 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.678098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.678108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.678217 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.679016 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.680135 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.681227 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.681587 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.681657 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.683217 (+ 1560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.683219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.683219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.683226 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.684887 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.685195 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.685195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.685196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.685281 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.685436 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.685436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.685436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.685561 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.685665 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.685720 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.685802 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1579,"thread_start_us":81,"threads_started":1}
WARNING: no policy specified for oryx/127.27.217.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.60.keytab.
Entry for principal oryx/127.27.217.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.60.keytab.
I20260809 16:16:11.710218 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.60:34415
--webserver_interface=127.27.217.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.60.keytab
--principal=oryx/127.27.217.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41665,127.27.217.61:35753,127.27.217.60:34415
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:11.791090 6953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:11.791290 6953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:11.791320 6953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:11.792469 6953 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:11.792510 6953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:11.792529 6953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:11.792544 6953 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:11.792559 6953 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:11.794009 6953 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41665,127.27.217.61:35753,127.27.217.60:34415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.60.keytab
--principal=oryx/127.27.217.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.60:34415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.217.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:11.794246 6953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:11.794445 6953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:11.798997 6961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.799024 6966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.799233 6953 server_base.cc:1034] running on GCE node
W20260809 16:16:11.799026 6959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.799481 6953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:11.799755 6953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:11.800891 6953 hybrid_clock.cc:648] HybridClock initialized: now 1786292171800883 us; error 27 us; skew 500 ppm
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:11.803180 6953 init.cc:377] Logged in from keytab as oryx/127.27.217.60@KRBTEST.COM (short username oryx)
I20260809 16:16:11.803540 6953 webserver.cc:460] Webserver started at http://127.27.217.60:35799/ using document root <none> and password file <none>
I20260809 16:16:11.803750 6953 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.803792 6953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.803892 6953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:11.804805 6953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data/instance:
uuid: "1841544938764c7b8b12a520b0a8f78b"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7a8941e814df266f78f6fede58758885"
server_key_iv: "1bdfafedd92da47bea2327cc83e21cb4"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.805099 6953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal/instance:
uuid: "1841544938764c7b8b12a520b0a8f78b"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7a8941e814df266f78f6fede58758885"
server_key_iv: "1bdfafedd92da47bea2327cc83e21cb4"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.806239 6953 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:11.806869 6973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.807030 6953 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:11.807114 6953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
uuid: "1841544938764c7b8b12a520b0a8f78b"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7a8941e814df266f78f6fede58758885"
server_key_iv: "1bdfafedd92da47bea2327cc83e21cb4"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.807164 6953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.823695 6953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:11.825444 6953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:11.825549 6953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:11.829214 6953 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.60:34415
I20260809 16:16:11.829253 7060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.60:34415 every 8 connection(s)
I20260809 16:16:11.829563 6953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
I20260809 16:16:11.830498 7061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:11.832027 7061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:16:11.835258 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 6953
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.60@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:11.840438 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.832809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57006 (local address 127.27.217.62:41665)
0809 16:16:11.832877 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.832879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.832955 (+ 76us) server_negotiation.cc:407] Connection header received
0809 16:16:11.833372 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.833372 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.833382 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.833431 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.833972 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.834452 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.835353 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.835615 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.835691 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.837802 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.837803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.837803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.837811 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.839103 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.839450 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.839451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.839451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.839508 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.839808 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.839809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.839809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.839969 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.840035 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.840301 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.840375 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 16:16:11.840627 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.832651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57006)
0809 16:16:11.832843 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.832887 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.833302 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.833489 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.833492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.833714 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.833909 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.833913 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.834514 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.834514 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.835268 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.835270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.835741 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.835742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.835884 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.836346 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.836354 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.837723 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.839160 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.839167 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.839169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.839382 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.839573 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.839573 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.839574 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.839694 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.840025 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.840031 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.840169 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.840268 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.840413 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":97,"threads_started":1}
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.217.60@KRBTEST.COM
I20260809 16:16:11.841176 7061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:16:11.844059 7069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.835867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47690 (local address 127.27.217.60:34415)
0809 16:16:11.836032 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.836036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.836055 (+ 19us) server_negotiation.cc:407] Connection header received
0809 16:16:11.836076 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.836078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.836097 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.836154 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.836721 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.837464 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.838340 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.838769 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.838841 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.841301 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.841307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.841308 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.841314 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.842911 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.843261 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.843264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.843265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.843325 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.843520 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.843521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.843521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.843706 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.843842 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.843900 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.843968 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.60@KRBTEST.COM for oryx/127.27.217.61@KRBTEST.COM
I20260809 16:16:11.846844 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.841395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.0.0.1:35976)
0809 16:16:11.841439 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.841449 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.841486 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.841621 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.841622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.841761 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.841815 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.841816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.842668 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.842669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.843182 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.843184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.843528 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.843529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.843594 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.843931 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.843935 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.845061 (+ 1126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.846184 (+ 1123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.846185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.846185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.846337 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.846467 (+ 130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.846467 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.846467 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.846505 (+ 38us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.846661 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.846661 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.846691 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.846731 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.846790 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 16:16:11.846879 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.841463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35976 (local address 127.27.217.61:35753)
0809 16:16:11.841521 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.841523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.841531 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:11.841555 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.841556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.841566 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.841608 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.841871 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.842595 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.843255 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.843472 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.843524 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.845131 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.845132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.845132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.845140 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.846125 (+ 985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.846388 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.846389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.846389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.846432 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.846535 (+ 103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.846536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.846536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.846626 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.846664 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.846748 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.846810 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:16:11.847157 7061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.60@KRBTEST.COM for oryx/127.27.217.60@KRBTEST.COM
I20260809 16:16:11.852134 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.847362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.0.0.1:47698)
0809 16:16:11.847399 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.847408 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.847449 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.847532 (+ 83us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.847532 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.847629 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.847654 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.847655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.848218 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.848219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.848652 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.848653 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.848919 (+ 266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.848919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.848950 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.849213 (+ 263us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.849216 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.850176 (+ 960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.851445 (+ 1269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.851445 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.851446 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.851577 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.851730 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.851730 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.851730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.851775 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.851953 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.851953 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.851983 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.852024 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.852081 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260809 16:16:11.852198 7069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.847390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47698 (local address 127.27.217.60:34415)
0809 16:16:11.847416 (+ 26us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.847418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.847437 (+ 19us) server_negotiation.cc:407] Connection header received
0809 16:16:11.847482 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.847482 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.847489 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.847528 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.847740 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.848165 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.848700 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.848876 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.848916 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.850256 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.850257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.850257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.850262 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.851387 (+ 1125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.851619 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.851619 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.851619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.851656 (+ 37us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.851815 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.851815 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.851815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.851901 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.851944 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.852069 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.852122 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12}
I20260809 16:16:11.853567 7061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Bootstrap starting.
I20260809 16:16:11.854146 7061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:11.854411 7061 log.cc:824] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:11.855062 7061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: No bootstrap required, opened a new log
I20260809 16:16:11.856480 7061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } }
I20260809 16:16:11.856594 7061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:11.856626 7061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1841544938764c7b8b12a520b0a8f78b, State: Initialized, Role: FOLLOWER
I20260809 16:16:11.856742 7061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } }
I20260809 16:16:11.856997 7071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } } }
I20260809 16:16:11.857033 7061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:11.857138 7071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: This master's current role is: FOLLOWER
W20260809 16:16:11.858775 7085 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:16:11.858860 7085 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:16:11.860713 6953 master_runner.cc:428] Detected that this master 1841544938764c7b8b12a520b0a8f78b is joining an existing cluster
I20260809 16:16:11.860761 6953 master_runner.cc:432] Initiating AddMaster RPC to add 127.27.217.60:34415
I20260809 16:16:11.868774 7093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.861813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57020)
0809 16:16:11.862051 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.862061 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.862130 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.862307 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.862307 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.862560 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.862644 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.862646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.863613 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.863614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.864541 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.864544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.865021 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.865022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.865072 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.865526 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.865530 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.865839 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.867422 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.867423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.867424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.867646 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.867950 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.867951 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.867952 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.868013 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.868411 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.868412 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.868469 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.868533 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.868625 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":31,"thread_start_us":204,"threads_started":1}
I20260809 16:16:11.869060 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.861900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57020 (local address 127.27.217.62:41665)
0809 16:16:11.861983 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.861985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.862107 (+ 122us) server_negotiation.cc:407] Connection header received
0809 16:16:11.862201 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.862201 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.862213 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.862243 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.862749 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.863533 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.864626 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.864908 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.864959 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.865925 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.865926 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.865927 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.865935 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.867338 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.867807 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.867808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.867809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.867870 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.868078 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.868079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.868079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.868204 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.868292 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.868894 (+ 602us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.868972 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292170, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.62@KRBTEST.COM for oryx/127.27.217.60@KRBTEST.COM
I20260809 16:16:11.887579 6790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.870874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.0.0.1:47702)
0809 16:16:11.870909 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.870919 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.870957 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.871267 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.871268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.871411 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.871444 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.871446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.872215 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.872215 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.872704 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.872706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.873046 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.873047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.873110 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.873444 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.873449 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.874606 (+ 1157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.885764 (+ 11158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.885765 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.885765 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.886002 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.886513 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.886514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.886515 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.886582 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.887273 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.887274 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.887330 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.887378 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.887481 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260809 16:16:11.887952 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.861887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35986 (local address 127.27.217.61:35753)
0809 16:16:11.861949 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.861952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.862146 (+ 194us) server_negotiation.cc:407] Connection header received
0809 16:16:11.862236 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.862236 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.862246 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.862283 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.862760 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.863488 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.864673 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.864958 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.864999 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.884888 (+ 19889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.884890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.884890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.884898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.886691 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.887146 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.887147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.887148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.887202 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.887399 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.887400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.887401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.887523 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.887563 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.887781 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.887860 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 16:16:11.888020 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.871008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47702 (local address 127.27.217.60:34415)
0809 16:16:11.871147 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.871149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.871155 (+ 6us) server_negotiation.cc:407] Connection header received
0809 16:16:11.871189 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.871189 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.871196 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.871252 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.871508 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.872148 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.872771 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.872989 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.873039 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.874701 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.874703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.874703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.874709 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.885690 (+ 10981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.886073 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.886075 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.886075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.886157 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.887010 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.887011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.887011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.887179 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.887783 (+ 604us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.887822 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.887895 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":84,"threads_started":1}
I20260809 16:16:11.888285 7095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.861819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.0.0.1:35986)
0809 16:16:11.862078 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.862089 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.862170 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.862356 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.862357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.862598 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.862669 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.862671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.863581 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.863582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.864575 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.864578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.865072 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.865072 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.865260 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.884233 (+ 18973us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.884238 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.884754 (+ 516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.886780 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.886780 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.886781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.887058 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.887280 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.887280 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.887281 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.887335 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.887605 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.887606 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.887644 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.888065 (+ 421us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.888165 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":39,"thread_start_us":87,"threads_started":1}
I20260809 16:16:11.888471 5845 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.27.217.60:34415: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "1841544938764c7b8b12a520b0a8f78b"
member_type: NON_VOTER
last_known_addr {
host: "127.27.217.60"
port: 34415
}
attrs {
promote: true
}
}
dest_uuid: "2b770a5f127d453d8f1ca4ef69319018"
cas_config_opid_index: 5
I20260809 16:16:11.888702 5845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } }
I20260809 16:16:11.889091 6792 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 1841544938764c7b8b12a520b0a8f78b (127.27.217.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.889217 7096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.862207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.0.0.1:47700)
0809 16:16:11.862433 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.862442 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.862509 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.862638 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.862638 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.862790 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.862850 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.862851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.863660 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.863661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.864680 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.864682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.865095 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.865095 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.865220 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.884501 (+ 19281us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.884508 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.885470 (+ 962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.887337 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.887338 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.887338 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.887523 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.887969 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.887970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.887970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.888030 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.888924 (+ 894us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.888925 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.888971 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.889025 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.889119 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":111,"thread_start_us":63,"threads_started":1}
I20260809 16:16:11.889540 7020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:11.889729 7069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.862148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47700 (local address 127.27.217.60:34415)
0809 16:16:11.862176 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.862177 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.862490 (+ 313us) server_negotiation.cc:407] Connection header received
0809 16:16:11.862565 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.862566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.862574 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.862596 (+ 22us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.862933 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.863590 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.864749 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.865005 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.865038 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.885567 (+ 20529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.885568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.885568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.885574 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.887269 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.887589 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.887590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.887590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.887637 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.888745 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.888745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.888746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.888871 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.888932 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.889588 (+ 656us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.889659 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 16:16:11.890027 6792 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.27.217.60:34415
I20260809 16:16:11.890125 6791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.890221 6791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:11.890483 7020 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Refusing update from remote peer 2b770a5f127d453d8f1ca4ef69319018: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 16:16:11.890743 6791 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:11.891026 6953 master.cc:537] Master@127.27.217.60:34415 shutting down...
W20260809 16:16:11.891388 5817 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 -> Peer 1841544938764c7b8b12a520b0a8f78b (127.27.217.60:34415): Couldn't send request to peer 1841544938764c7b8b12a520b0a8f78b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 16:16:11.893906 6953 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:11.893993 6953 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:11.894040 6953 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: stopping tablet replica
I20260809 16:16:11.894116 6790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.889138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.0.0.1:35994)
0809 16:16:11.890655 (+ 1517us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.890666 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.890702 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.890916 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.890917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.890918 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:11.890958 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.890960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.891899 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.891900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.893075 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.893078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.893878 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.893879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.893941 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.893967 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.894018 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.894053 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1498}
I20260809 16:16:11.894367 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.889260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35994 (local address 127.27.217.61:35753)
0809 16:16:11.890769 (+ 1509us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.890771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.890777 (+ 6us) server_negotiation.cc:407] Connection header received
0809 16:16:11.890795 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.890796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.890820 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.890884 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:11.891046 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.891811 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.893165 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.893805 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.893871 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.893968 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.894270 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.894310 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1486}
I20260809 16:16:11.894562 6870 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 LEARNER]: Refusing update from remote peer 2b770a5f127d453d8f1ca4ef69319018: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 16:16:11.894765 6791 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 16:16:11.895486 6870 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 1841544938764c7b8b12a520b0a8f78b (127.27.217.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.896961 6791 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: attempting to promote NON_VOTER 8c72c0139d6140d9b4f4ecbe2c5adaef to VOTER
I20260809 16:16:11.897102 6923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b770a5f127d453d8f1ca4ef69319018. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.897182 6923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: This master's current role is: LEARNER
I20260809 16:16:11.897182 6791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } }
I20260809 16:16:11.897218 6923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: NON_VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: true } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.897255 6923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: This master's current role is: LEARNER
I20260809 16:16:11.898134 6870 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 LEARNER]: Refusing update from remote peer 2b770a5f127d453d8f1ca4ef69319018: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 16:16:11.898329 7101 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260809 16:16:11.898411 5817 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 -> Peer 1841544938764c7b8b12a520b0a8f78b (127.27.217.60:34415): Couldn't send request to peer 1841544938764c7b8b12a520b0a8f78b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 16:16:11.898914 6792 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8c72c0139d6140d9b4f4ecbe2c5adaef (127.27.217.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
W20260809 16:16:11.899091 5765 connection.cc:535] client connection to 127.27.217.60:34415 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 16:16:11.899818 6791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.899915 6791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:11.899919 6870 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8c72c0139d6140d9b4f4ecbe2c5adaef (127.27.217.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.899832 6792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.900902 6792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:11.900903 7100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.901000 7100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:16:11.902621 7096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.902501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.0.0.1:47704)
0809 16:16:11.902570 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.902600 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 16:16:11.910341 6953 master.cc:552] Master@127.27.217.60:34415 shutdown complete.
I20260809 16:16:11.910382 6953 master_runner.cc:305] Clearing existing system tablet
I20260809 16:16:11.910507 6953 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.910547 6953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.911075 6953 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:11.911495 7105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.911612 6953 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.911697 6953 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.911725 6953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
uuid: "1841544938764c7b8b12a520b0a8f78b"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7a8941e814df266f78f6fede58758885"
server_key_iv: "1bdfafedd92da47bea2327cc83e21cb4"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.912504 6953 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:11.913823 6953 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 16:16:11.913892 6953 log.cc:1196] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 16:16:11.914078 6953 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Deleting consensus metadata
I20260809 16:16:11.914191 6953 master_runner.cc:315] Copying system tablet from 127.27.217.62:41665
I20260809 16:16:11.914783 6953 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: tablet copy: Beginning tablet copy session from remote peer at address 127.27.217.62:41665
I20260809 16:16:11.920990 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.915108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57034 (local address 127.27.217.62:41665)
0809 16:16:11.915160 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.915162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.915328 (+ 166us) server_negotiation.cc:407] Connection header received
0809 16:16:11.915393 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.915394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.915402 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.915452 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.915813 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.916279 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.917224 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.917392 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.917430 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.918739 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.918740 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.918741 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.918747 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.920043 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.920391 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.920391 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.920392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.920436 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.920600 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.920600 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.920601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.920690 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.920734 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.920877 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.920930 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:11.921056 7121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.915025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57034)
0809 16:16:11.915250 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:11.915261 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:11.915336 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:11.915472 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:11.915473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:11.915701 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:11.915752 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.915754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.916343 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.916344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.917154 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:11.917157 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.917445 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.917446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:11.917507 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.918291 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:11.918296 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:11.918656 (+ 360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:11.920114 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.920115 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.920115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.920330 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.920494 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:11.920494 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:11.920495 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:11.920555 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:11.920741 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:11.920741 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:11.920787 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 16:16:11.920858 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:16:11.920954 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":64,"threads_started":1}
I20260809 16:16:11.921309 5884 tablet_copy_service.cc:140] P 2b770a5f127d453d8f1ca4ef69319018: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 1841544938764c7b8b12a520b0a8f78b ({username='oryx', principal='oryx/127.27.217.60@KRBTEST.COM'} at 127.0.0.1:57034)
I20260809 16:16:11.921357 5884 tablet_copy_service.cc:161] P 2b770a5f127d453d8f1ca4ef69319018: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 1841544938764c7b8b12a520b0a8f78b at {username='oryx', principal='oryx/127.27.217.60@KRBTEST.COM'} at 127.0.0.1:57034: session id = 1841544938764c7b8b12a520b0a8f78b-00000000000000000000000000000000
I20260809 16:16:11.921773 5884 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 16:16:11.922189 6953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 16:16:11.923107 6953 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: tablet copy: Starting download of 0 data blocks...
I20260809 16:16:11.923235 6953 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: tablet copy: Starting download of 1 WAL segments...
I20260809 16:16:11.923981 6953 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 16:16:11.924716 5884 tablet_copy_service.cc:342] P 2b770a5f127d453d8f1ca4ef69319018: Request end of tablet copy session 1841544938764c7b8b12a520b0a8f78b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.27.217.60@KRBTEST.COM'} at 127.0.0.1:57034
I20260809 16:16:11.924762 5884 tablet_copy_service.cc:433] P 2b770a5f127d453d8f1ca4ef69319018: ending tablet copy session 1841544938764c7b8b12a520b0a8f78b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 1841544938764c7b8b12a520b0a8f78b
I20260809 16:16:11.926927 6953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:11.927964 7123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:11.927970 7124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.928033 6953 server_base.cc:1034] running on GCE node
W20260809 16:16:11.928191 7127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:11.928304 6953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:11.928426 6953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:11.929550 6953 hybrid_clock.cc:648] HybridClock initialized: now 1786292171929542 us; error 25 us; skew 500 ppm
Aug 09 16:16:11 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292171, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:11.930796 6953 init.cc:377] Logged in from keytab as oryx/127.27.217.60@KRBTEST.COM (short username oryx)
I20260809 16:16:11.931046 6953 webserver.cc:460] Webserver started at http://127.27.217.60:42975/ using document root <none> and password file <none>
I20260809 16:16:11.931154 6953 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:11.931187 6953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:11.931869 6953 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:11.932382 7141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:11.932487 6953 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:11.932533 6953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
uuid: "1841544938764c7b8b12a520b0a8f78b"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7a8941e814df266f78f6fede58758885"
server_key_iv: "1bdfafedd92da47bea2327cc83e21cb4"
server_key_version: "encryptionkey@0"
I20260809 16:16:11.932585 6953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:11.944084 6953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:11.945538 6953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:11.948448 6953 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.60:34415
I20260809 16:16:11.948590 7220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.60:34415 every 8 connection(s)
I20260809 16:16:11.948776 6953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
I20260809 16:16:11.949565 7221 sys_catalog.cc:263] Verifying existing consensus state
I20260809 16:16:11.950021 7221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Bootstrap starting.
I20260809 16:16:11.952491 7221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:16:11.952723 7221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: Bootstrap complete.
I20260809 16:16:11.952932 7221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } }
I20260809 16:16:11.953022 7221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1841544938764c7b8b12a520b0a8f78b, State: Initialized, Role: LEARNER
I20260809 16:16:11.953058 7221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } }
I20260809 16:16:11.953222 7221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:11.953248 7227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:11.953470 7227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: This master's current role is: LEARNER
I20260809 16:16:11.954682 7247 catalog_manager.cc:1259] Loaded cluster ID: 3d0e61d153e2458d8bfbee767b8cbfa8
I20260809 16:16:11.955052 7247 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: loading cluster ID for follower catalog manager: success
I20260809 16:16:11.957496 7247 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: acquiring CA information for follower catalog manager: success
I20260809 16:16:11.957887 7247 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 16:16:11.958753 7225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:11.949539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47718 (local address 127.27.217.60:34415)
0809 16:16:11.951768 (+ 2229us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:11.951770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:11.951780 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:11.951803 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:11.951804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:11.951814 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:11.951886 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:11.952597 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.953538 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.954518 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:11.954811 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:11.954876 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:11.956135 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:11.956136 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:11.956137 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:11.956143 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:11.957557 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.957928 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.957930 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.957930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.958017 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:11.958184 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:11.958184 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:11.958185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:11.958287 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:11.958370 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:11.958557 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 16:16:11.958645 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2202,"thread_start_us":85,"threads_started":1}
I20260809 16:16:11.959249 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 5948
I20260809 16:16:11.969532 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:34137
--local_ip_for_outbound_sockets=127.27.217.1
--tserver_master_addrs=127.27.217.62:41665
--webserver_port=43013
--webserver_interface=127.27.217.1
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab
--principal=oryx/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753,127.27.217.60:34415 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:12.049614 7248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:12.049803 7248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:12.049844 7248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:12.050963 7248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:12.051000 7248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:12.051034 7248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:12.052485 7248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab
--principal=oryx/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:34137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=43013
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753,127.27.217.60:34415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:12.052723 7248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:12.052964 7248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:12.057889 7257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:12.057933 7260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:12.058055 7248 server_base.cc:1034] running on GCE node
W20260809 16:16:12.057895 7256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:12.058319 7248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:12.058539 7248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:12.059725 7248 hybrid_clock.cc:648] HybridClock initialized: now 1786292172059710 us; error 30 us; skew 500 ppm
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:12.062173 7248 init.cc:377] Logged in from keytab as oryx/127.27.217.1@KRBTEST.COM (short username oryx)
I20260809 16:16:12.062572 7248 webserver.cc:460] Webserver started at http://127.27.217.1:43013/ using document root <none> and password file <none>
I20260809 16:16:12.062793 7248 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:12.062855 7248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:12.064172 7248 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:12.064693 7269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.064833 7248 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:12.064911 7248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "42d3859f811f4e8a9b684359edcf26cf"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "7c67a0352e259e369da3dace6a90631a"
server_key_iv: "e8b4cc235945ffec667c28bdcaf24ddf"
server_key_version: "encryptionkey@0"
I20260809 16:16:12.065212 7248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:12.082054 7248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:12.084148 7248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:12.084293 7248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:12.084532 7248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:12.084834 7248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:12.084869 7248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.084898 7248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:12.084915 7248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.091164 7248 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:34137
I20260809 16:16:12.091205 7460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:34137 every 8 connection(s)
I20260809 16:16:12.091537 7248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:12.094592 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 7248
I20260809 16:16:12.094759 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 6179
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.60@KRBTEST.COM
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.61@KRBTEST.COM
I20260809 16:16:12.104195 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.092284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:33759 (local address 127.27.217.61:35753)
0809 16:16:12.092328 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.092329 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.092543 (+ 214us) server_negotiation.cc:407] Connection header received
0809 16:16:12.093607 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.093609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.093620 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.093674 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.094091 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.094835 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096282 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.096591 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096628 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.100582 (+ 3954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.100583 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.100584 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.100591 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.102596 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.103158 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.103159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.103159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.103211 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.103444 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.103445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.103446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.103594 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.103652 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.104021 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.104102 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:16:12.104254 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.092258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:46997 (local address 127.27.217.62:41665)
0809 16:16:12.092307 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.092310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.092649 (+ 339us) server_negotiation.cc:407] Connection header received
0809 16:16:12.093216 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.093217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.093231 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.093283 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.094064 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.094839 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096281 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.096588 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096628 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.099724 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.099726 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.099726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.099734 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.101981 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.103466 (+ 1485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.103467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.103468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.103520 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.103729 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.103730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.103731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.103850 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.103905 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.104105 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.104174 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 16:16:12.104787 7466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.092245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.27.217.1:33759)
0809 16:16:12.092423 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.092459 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.093517 (+ 1058us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.093687 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.093688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.093851 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.093977 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.093983 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.094928 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.094929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.096180 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.096183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.096718 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.096874 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.097817 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.097821 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.100496 (+ 2675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.102964 (+ 2468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.102965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.102965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.103097 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.103264 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.103264 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.103264 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.103381 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.103698 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.103705 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.103857 (+ 152us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.104325 (+ 468us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.104506 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":38,"thread_start_us":103,"threads_started":1}
I20260809 16:16:12.104787 7469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.092245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:46997)
0809 16:16:12.092594 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.092603 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.093114 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.093362 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.093366 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.093752 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.093975 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.093980 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.094928 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.094929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.096180 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.096183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.096716 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096716 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.096873 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.097768 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.097777 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.099590 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.102671 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.102677 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.102679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.102909 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.103587 (+ 678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.103588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.103588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.103639 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.103950 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.103951 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.103988 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.104326 (+ 338us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.104569 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":303,"spinlock_wait_cycles":384,"thread_start_us":90,"threads_started":1}
I20260809 16:16:12.105332 7464 heartbeater.cc:347] Connected to a master server at 127.27.217.61:35753
I20260809 16:16:12.105413 7464 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.105552 7464 heartbeater.cc:511] Master 127.27.217.61:35753 requested a full tablet report, sending...
I20260809 16:16:12.106001 6856 ts_manager.cc:194] Registered new tserver with Master: 42d3859f811f4e8a9b684359edcf26cf (127.27.217.1:34137)
I20260809 16:16:12.122189 7462 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41665
I20260809 16:16:12.122251 7462 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.122342 7462 heartbeater.cc:511] Master 127.27.217.62:41665 requested a full tablet report, sending...
I20260809 16:16:12.122933 5845 ts_manager.cc:194] Re-registered known tserver with Master: 42d3859f811f4e8a9b684359edcf26cf (127.27.217.1:34137)
I20260809 16:16:12.123432 5845 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:46997
I20260809 16:16:12.124850 7225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.092631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:42953 (local address 127.27.217.60:34415)
0809 16:16:12.092683 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.092684 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.092723 (+ 39us) server_negotiation.cc:407] Connection header received
0809 16:16:12.093346 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.093347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.093359 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.093419 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.094085 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.094704 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096350 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.096738 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096785 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.122141 (+ 25356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.122143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.122143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.122154 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.123809 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.124116 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.124117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.124118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.124175 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.124337 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.124338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.124338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.124452 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.124509 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.124654 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.124756 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:16:12.124871 7470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.092555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.27.217.1:42953)
0809 16:16:12.092667 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.092676 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.093126 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.093467 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.093468 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.093759 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.093977 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.093983 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.094835 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.094836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.096234 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.096237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.096875 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.096876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.096947 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.097877 (+ 930us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.097883 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.122008 (+ 24125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.123886 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.123887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.123887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.124055 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.124227 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.124228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.124228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.124287 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.124506 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.124507 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.124550 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.124623 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.124754 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":165,"thread_start_us":59,"threads_started":1}
I20260809 16:16:12.125154 7461 heartbeater.cc:347] Connected to a master server at 127.27.217.60:34415
I20260809 16:16:12.125204 7461 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.125263 7461 heartbeater.cc:511] Master 127.27.217.60:34415 requested a full tablet report, sending...
I20260809 16:16:12.125665 7170 ts_manager.cc:194] Registered new tserver with Master: 42d3859f811f4e8a9b684359edcf26cf (127.27.217.1:34137)
I20260809 16:16:12.126431 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:45051
--local_ip_for_outbound_sockets=127.27.217.2
--tserver_master_addrs=127.27.217.62:41665
--webserver_port=40241
--webserver_interface=127.27.217.2
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab
--principal=oryx/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753,127.27.217.60:34415 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:12.207436 7474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:12.207626 7474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:12.207656 7474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:12.208788 7474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:12.208829 7474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:12.208863 7474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:12.210325 7474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab
--principal=oryx/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:45051
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=40241
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753,127.27.217.60:34415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:12.210548 7474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:12.210757 7474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:12.215422 7482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:12.215431 7483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:12.215436 7486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:12.215620 7474 server_base.cc:1034] running on GCE node
I20260809 16:16:12.215852 7474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:12.216060 7474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:12.217200 7474 hybrid_clock.cc:648] HybridClock initialized: now 1786292172217185 us; error 30 us; skew 500 ppm
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:12.219447 7474 init.cc:377] Logged in from keytab as oryx/127.27.217.2@KRBTEST.COM (short username oryx)
I20260809 16:16:12.219877 7474 webserver.cc:460] Webserver started at http://127.27.217.2:40241/ using document root <none> and password file <none>
I20260809 16:16:12.220074 7474 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:12.220132 7474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:12.221359 7474 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:12.221946 7497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.222095 7474 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:12.222175 7474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "939121d7035044a89ec3c1f0fe8f9d02"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "8bc853853ef3234428482207eb01beae"
server_key_iv: "5857fd306d0cc6e481a9df4dbbbc3be1"
server_key_version: "encryptionkey@0"
I20260809 16:16:12.222466 7474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:12.237898 7474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:12.239880 7474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:12.240008 7474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:12.240195 7474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:12.240491 7474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:12.240531 7474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.240558 7474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:12.240583 7474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.246137 7474 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:45051
I20260809 16:16:12.246188 7692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:45051 every 8 connection(s)
I20260809 16:16:12.246505 7474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:16:12.251549 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 7474
I20260809 16:16:12.251745 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 6419
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.61@KRBTEST.COM
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.60@KRBTEST.COM
I20260809 16:16:12.261509 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.247214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:53037 (local address 127.27.217.62:41665)
0809 16:16:12.247263 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.247265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.247743 (+ 478us) server_negotiation.cc:407] Connection header received
0809 16:16:12.248601 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.248602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.248614 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.248691 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.249535 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.250036 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.251401 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.251702 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.251790 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.256666 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.256668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.256669 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.256677 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.260061 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.260598 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.260599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.260600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.260664 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.260907 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.260908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.260908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.261019 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.261053 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.261357 (+ 304us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.261430 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:16:12.262233 7704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.247234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:53037)
0809 16:16:12.247662 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.247688 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.248483 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.249014 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.249015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.249224 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.249408 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.249413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.250134 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.250135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.251295 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.251297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.251853 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.251854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.251985 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.254634 (+ 2649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.254644 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.256540 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.260163 (+ 3623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.260172 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.260174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.260508 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.260738 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.260738 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.260739 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.260851 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.261086 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.261091 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.261236 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.261586 (+ 350us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.261935 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":32,"thread_start_us":98,"threads_started":1}
I20260809 16:16:12.262832 7699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.247234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.27.217.2:51433)
0809 16:16:12.247414 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.247449 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.248468 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.248770 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.248774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.249210 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.249407 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.249412 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.250375 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.250376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.251295 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.251297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.255072 (+ 3775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.255072 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.255135 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.256272 (+ 1137us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.256277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.257547 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.261485 (+ 3938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.261486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.261487 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.261942 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.262119 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.262120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.262120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.262161 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.262537 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.262538 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.262573 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.262625 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.262705 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":25,"thread_start_us":104,"threads_started":1}
I20260809 16:16:12.262897 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.247496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:51433 (local address 127.27.217.61:35753)
0809 16:16:12.247566 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.247568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.247578 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:12.248600 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.248601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.248614 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.248691 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.249500 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.250291 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.254413 (+ 4122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.254782 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.254861 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.257651 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.257653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.257653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.257660 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.261382 (+ 3722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.262014 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.262016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.262016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.262065 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.262207 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.262208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.262208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.262308 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.262340 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.262692 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.262797 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 16:16:12.264902 7696 heartbeater.cc:347] Connected to a master server at 127.27.217.61:35753
I20260809 16:16:12.265012 7696 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.265056 7695 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41665
I20260809 16:16:12.265198 7695 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.265266 7696 heartbeater.cc:511] Master 127.27.217.61:35753 requested a full tablet report, sending...
I20260809 16:16:12.265306 7695 heartbeater.cc:511] Master 127.27.217.62:41665 requested a full tablet report, sending...
I20260809 16:16:12.265739 6856 ts_manager.cc:194] Registered new tserver with Master: 939121d7035044a89ec3c1f0fe8f9d02 (127.27.217.2:45051)
I20260809 16:16:12.266053 5845 ts_manager.cc:194] Re-registered known tserver with Master: 939121d7035044a89ec3c1f0fe8f9d02 (127.27.217.2:45051)
I20260809 16:16:12.266497 5845 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:53037
I20260809 16:16:12.268181 7225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.247725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:50805 (local address 127.27.217.60:34415)
0809 16:16:12.247768 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.247770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.248698 (+ 928us) server_negotiation.cc:407] Connection header received
0809 16:16:12.248774 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.248776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.248786 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.248825 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.249553 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.250303 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.254679 (+ 4376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.254970 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.255016 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.265438 (+ 10422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.265439 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.265440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.265448 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.267147 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.267538 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.267539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.267539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.267598 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.267783 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.267785 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.267785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.267893 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.267941 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.268057 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.268120 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 16:16:12.268256 7698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.247542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.27.217.2:50805)
0809 16:16:12.248645 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.248653 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.248723 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.248835 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.248836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.249152 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.249408 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.249413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.251387 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.251388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.254581 (+ 3193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.254584 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.255342 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.255343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.255401 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.259203 (+ 3802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.259208 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.265332 (+ 6124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.267239 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.267240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.267241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.267439 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.267649 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.267649 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.267649 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.267731 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.267944 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.267945 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.267984 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.268036 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.268141 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"mutex_wait_us":6,"thread_start_us":69,"threads_started":1}
I20260809 16:16:12.268750 7694 heartbeater.cc:347] Connected to a master server at 127.27.217.60:34415
I20260809 16:16:12.268819 7694 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.268891 7694 heartbeater.cc:511] Master 127.27.217.60:34415 requested a full tablet report, sending...
I20260809 16:16:12.269168 7170 ts_manager.cc:194] Registered new tserver with Master: 939121d7035044a89ec3c1f0fe8f9d02 (127.27.217.2:45051)
I20260809 16:16:12.269533 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:45789
--local_ip_for_outbound_sockets=127.27.217.3
--tserver_master_addrs=127.27.217.62:41665
--webserver_port=37039
--webserver_interface=127.27.217.3
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab
--principal=oryx/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753,127.27.217.60:34415 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:12.348793 7705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:12.348987 7705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:12.349016 7705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:12.350133 7705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:12.350173 7705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:12.350206 7705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:12.351648 7705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab
--principal=oryx/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:45789
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=37039
--tserver_master_addrs=127.27.217.62:41665,127.27.217.61:35753,127.27.217.60:34415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:12.351889 7705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:12.352092 7705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:12.356905 7717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:12.356913 7714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:12.356913 7720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:12.356964 7705 server_base.cc:1034] running on GCE node
I20260809 16:16:12.357237 7705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:12.357440 7705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:12.358569 7705 hybrid_clock.cc:648] HybridClock initialized: now 1786292172358567 us; error 38 us; skew 500 ppm
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:12.360826 7705 init.cc:377] Logged in from keytab as oryx/127.27.217.3@KRBTEST.COM (short username oryx)
I20260809 16:16:12.361176 7705 webserver.cc:460] Webserver started at http://127.27.217.3:37039/ using document root <none> and password file <none>
I20260809 16:16:12.361343 7705 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:12.361394 7705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:12.362619 7705 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:12.363129 7729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.363270 7705 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.363359 7705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2"
format_stamp: "Formatted at 2026-08-09 16:16:11 on dist-test-slave-nj21"
server_key: "77a681bf85ba45da8db182bf3c0e4d3a"
server_key_iv: "75974609a8afd65b7663567187293485"
server_key_version: "encryptionkey@0"
I20260809 16:16:12.363646 7705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:12.379410 7705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:12.381425 7705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:12.381533 7705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:12.381691 7705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:12.381935 7705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:12.381963 7705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.381997 7705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:12.382014 7705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:12.387516 7705 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:45789
I20260809 16:16:12.387583 7918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:45789 every 8 connection(s)
I20260809 16:16:12.387894 7705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:12.394394 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 7705
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.61@KRBTEST.COM
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.60@KRBTEST.COM
Aug 09 16:16:12 dist-test-slave-nj21 krb5kdc[5768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292172, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:12.399062 7929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.388865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.27.217.3:56793)
0809 16:16:12.389055 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.389063 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.389874 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.390102 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.390103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.390483 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.390676 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.390681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.391643 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.391644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.392388 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.392390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.392795 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.392795 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.392890 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.393387 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.393396 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.395434 (+ 2038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.397524 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.397530 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.397532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.397833 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.398038 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398038 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.398039 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.398161 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.398430 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.398436 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.398584 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.398678 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.398843 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":1,"thread_start_us":69,"threads_started":1}
I20260809 16:16:12.399094 7928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.388579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:57365)
0809 16:16:12.388844 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.388852 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.389858 (+ 1006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.390169 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.390169 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.390492 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.390677 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.390683 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.391624 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.391625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.392539 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.392541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.393306 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.393307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.393371 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.393674 (+ 303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.393679 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.396047 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.397948 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.397949 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.397949 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.398167 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.398443 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398443 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.398444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.398501 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.398773 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.398774 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.398817 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.398892 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.398993 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":35,"thread_start_us":115,"threads_started":1}
I20260809 16:16:12.399127 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.388649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:36267 (local address 127.27.217.61:35753)
0809 16:16:12.388700 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.388702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.388909 (+ 207us) server_negotiation.cc:407] Connection header received
0809 16:16:12.389964 (+ 1055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.389965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.389978 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.390027 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.390780 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.391311 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.392628 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.392893 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.392940 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.396217 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.396218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.396219 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.396226 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.398004 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398338 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.398339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.398339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.398406 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398579 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.398580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.398580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.398694 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.398748 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.398977 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.399046 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:16:12.399394 7225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.388967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:56793 (local address 127.27.217.60:34415)
0809 16:16:12.389013 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.389015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.389106 (+ 91us) server_negotiation.cc:407] Connection header received
0809 16:16:12.389974 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.389975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.389986 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.390016 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.390768 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.391561 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.392471 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.392691 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.392754 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.395546 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.395547 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.395548 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.395556 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.397440 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.397911 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.397913 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.397913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.397972 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398226 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.398226 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.398227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.398353 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.398406 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.399215 (+ 809us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.399299 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:12.399600 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.388570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:57365 (local address 127.27.217.62:41665)
0809 16:16:12.388629 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.388631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.388909 (+ 278us) server_negotiation.cc:407] Connection header received
0809 16:16:12.390086 (+ 1177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.390088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.390101 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.390155 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.390809 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.391548 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.392988 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.393241 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.393306 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.396132 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.396133 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.396134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.396140 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.397841 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398240 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.398241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.398242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.398318 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398567 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.398568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.398568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.398691 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.398748 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.399182 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.399520 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:16:12.399876 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.388579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.27.217.3:36267)
0809 16:16:12.388785 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.388826 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.389869 (+ 1043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.390090 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.390093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.390495 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:12.390677 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.390683 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.391431 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.391432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.392540 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.392541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.392958 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.392959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.393022 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.393508 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:12.393512 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:12.396139 (+ 2627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:12.398076 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398077 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.398077 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.398266 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.398469 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:12.398470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:12.398470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:12.398516 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:12.398773 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:12.398774 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:12.398817 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.398890 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.399766 (+ 876us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":784,"thread_start_us":113,"threads_started":1}
I20260809 16:16:12.400736 7923 heartbeater.cc:347] Connected to a master server at 127.27.217.61:35753
I20260809 16:16:12.400851 7923 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.400866 7921 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41665
I20260809 16:16:12.401032 7921 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.401062 7923 heartbeater.cc:511] Master 127.27.217.61:35753 requested a full tablet report, sending...
I20260809 16:16:12.401325 7921 heartbeater.cc:511] Master 127.27.217.62:41665 requested a full tablet report, sending...
I20260809 16:16:12.401106 7919 heartbeater.cc:347] Connected to a master server at 127.27.217.60:34415
I20260809 16:16:12.401556 7919 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:12.401636 7919 heartbeater.cc:511] Master 127.27.217.60:34415 requested a full tablet report, sending...
I20260809 16:16:12.401664 5845 ts_manager.cc:194] Re-registered known tserver with Master: ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789)
I20260809 16:16:12.401762 6856 ts_manager.cc:194] Registered new tserver with Master: ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789)
I20260809 16:16:12.402120 5845 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:57365
I20260809 16:16:12.402570 7170 ts_manager.cc:194] Registered new tserver with Master: ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789)
I20260809 16:16:12.403833 7938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.395430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57036 (local address 127.27.217.62:41665)
0809 16:16:12.396012 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.396014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.396021 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:16:12.396043 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.396044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.396055 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.396112 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.396883 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.397632 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.398601 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.398885 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.398942 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.400563 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.400564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.400565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.400571 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.402383 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.403011 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.403012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.403013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.403065 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.403243 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.403244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.403244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.403364 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.403448 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.403621 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.403732 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":56,"threads_started":1}
I20260809 16:16:12.405315 5845 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57036:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:12.407158 5845 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:12.408352 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.395548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35996 (local address 127.27.217.61:35753)
0809 16:16:12.396734 (+ 1186us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.396736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.399837 (+ 3101us) server_negotiation.cc:407] Connection header received
0809 16:16:12.400036 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.400037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.400051 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.400095 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.401985 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.402666 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.403532 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.403828 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.403873 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.405629 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.405630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.405630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.405637 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.407206 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.407508 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.407509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.407509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.407561 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.407786 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.407787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.407787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.407918 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.407993 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.408183 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.408267 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1164,"thread_start_us":63,"threads_started":1}
I20260809 16:16:12.410392 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.395885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47732 (local address 127.27.217.60:34415)
0809 16:16:12.399368 (+ 3483us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.399370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.400954 (+ 1584us) server_negotiation.cc:407] Connection header received
0809 16:16:12.403266 (+ 2312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.403267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.403279 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.403341 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.403980 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.404651 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.405704 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.405984 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.406050 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.407251 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.407252 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.407253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.407259 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.408926 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.409290 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.409291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.409292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.409350 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.409648 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.409649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.409649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.409777 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.410189 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.410227 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.410303 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3442,"thread_start_us":61,"threads_started":1}
I20260809 16:16:12.414635 7955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.411256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:34137 (local address 127.0.0.1:43238)
0809 16:16:12.411751 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.411762 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.411814 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.412053 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.412054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.412056 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:12.412097 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.412106 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.413012 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.413012 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.413718 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.413720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.414407 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.414408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.414473 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.414477 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.414530 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.414569 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":80,"threads_started":1}
I20260809 16:16:12.414656 7959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.411372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43238 (local address 127.27.217.1:34137)
0809 16:16:12.411551 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.411556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.411867 (+ 311us) server_negotiation.cc:407] Connection header received
0809 16:16:12.411906 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.411908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.411921 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.411985 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:12.412182 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.412944 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.413799 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.414325 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.414389 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.414469 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.414544 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.414582 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
I20260809 16:16:12.415436 7352 tablet_service.cc:1467] Processing CreateTablet for tablet c8e5f6b1094d46c4b115f7cae46a1331 (DEFAULT_TABLE table=test-table [id=b2fc6e3bd303482a99eadce4177591a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:12.415729 7958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.411320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:45051 (local address 127.0.0.1:38290)
0809 16:16:12.411785 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.411794 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.411842 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.412360 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.412360 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.412362 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:12.412399 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.412401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.413541 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.413542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.414604 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.414606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.415509 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.415509 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.415557 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.415560 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.415587 (+ 27us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.415616 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":14,"thread_start_us":79,"threads_started":1}
I20260809 16:16:12.415728 7956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.411238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:45789 (local address 127.0.0.1:56110)
0809 16:16:12.411569 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.411580 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.411643 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.412078 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.412079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.412081 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:12.412130 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.412132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.413316 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.413317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.414492 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.414495 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.415461 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.415462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.415522 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.415526 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.415577 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.415614 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":26,"thread_start_us":95,"threads_started":1}
I20260809 16:16:12.415795 7352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8e5f6b1094d46c4b115f7cae46a1331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:12.416086 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.411558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38290 (local address 127.27.217.2:45051)
0809 16:16:12.412194 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.412198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.412207 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:12.412245 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.412247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.412272 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.412349 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:12.412462 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.413457 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.414681 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.415427 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.415909 (+ 482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.415982 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.416003 (+ 21us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.416030 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":82,"threads_started":1}
I20260809 16:16:12.416250 7963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.411553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56110 (local address 127.27.217.3:45789)
0809 16:16:12.411945 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.411949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.411958 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:12.411991 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.411993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.412007 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.412079 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:12.412214 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.413220 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.414587 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.415284 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.415331 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.415396 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.415650 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.415713 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":98,"threads_started":1}
I20260809 16:16:12.416693 7584 tablet_service.cc:1467] Processing CreateTablet for tablet c8e5f6b1094d46c4b115f7cae46a1331 (DEFAULT_TABLE table=test-table [id=b2fc6e3bd303482a99eadce4177591a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:12.416949 7584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8e5f6b1094d46c4b115f7cae46a1331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:12.416967 7816 tablet_service.cc:1467] Processing CreateTablet for tablet c8e5f6b1094d46c4b115f7cae46a1331 (DEFAULT_TABLE table=test-table [id=b2fc6e3bd303482a99eadce4177591a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:12.417299 7816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8e5f6b1094d46c4b115f7cae46a1331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:12.419447 7966 tablet_bootstrap.cc:492] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Bootstrap starting.
I20260809 16:16:12.419559 7965 tablet_bootstrap.cc:492] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Bootstrap starting.
I20260809 16:16:12.420210 7965 tablet_bootstrap.cc:654] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:12.420210 7966 tablet_bootstrap.cc:654] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:12.420550 7967 tablet_bootstrap.cc:492] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Bootstrap starting.
I20260809 16:16:12.420567 7966 log.cc:824] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:12.420567 7965 log.cc:824] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:12.421130 7967 tablet_bootstrap.cc:654] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:12.421299 7965 tablet_bootstrap.cc:492] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: No bootstrap required, opened a new log
I20260809 16:16:12.421375 7965 ts_tablet_manager.cc:1397] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:12.421425 7967 log.cc:824] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:12.421463 7966 tablet_bootstrap.cc:492] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: No bootstrap required, opened a new log
I20260809 16:16:12.421514 7966 ts_tablet_manager.cc:1397] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 16:16:12.423825 7966 raft_consensus.cc:348] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.423991 7966 raft_consensus.cc:374] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:12.423915 7965 raft_consensus.cc:348] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.424038 7965 raft_consensus.cc:374] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:12.424034 7966 raft_consensus.cc:729] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 939121d7035044a89ec3c1f0fe8f9d02, State: Initialized, Role: FOLLOWER
I20260809 16:16:12.424067 7965 raft_consensus.cc:729] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d3859f811f4e8a9b684359edcf26cf, State: Initialized, Role: FOLLOWER
I20260809 16:16:12.424186 7967 tablet_bootstrap.cc:492] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: No bootstrap required, opened a new log
I20260809 16:16:12.424185 7965 consensus_queue.cc:260] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.424185 7966 consensus_queue.cc:260] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.424252 7967 ts_tablet_manager.cc:1397] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 16:16:12.424436 7966 ts_tablet_manager.cc:1428] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 16:16:12.424436 7965 ts_tablet_manager.cc:1428] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:16:12.424736 7462 heartbeater.cc:503] Master 127.27.217.62:41665 was elected leader, sending a full tablet report...
I20260809 16:16:12.425283 7695 heartbeater.cc:503] Master 127.27.217.62:41665 was elected leader, sending a full tablet report...
I20260809 16:16:12.426810 7967 raft_consensus.cc:348] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.426934 7967 raft_consensus.cc:374] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:12.426963 7967 raft_consensus.cc:729] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4dff17d0a741d1a12bd0ea148cd3c2, State: Initialized, Role: FOLLOWER
I20260809 16:16:12.427067 7967 consensus_queue.cc:260] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.427274 7967 ts_tablet_manager.cc:1428] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:16:12.427340 7921 heartbeater.cc:503] Master 127.27.217.62:41665 was elected leader, sending a full tablet report...
I20260809 16:16:12.460541 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.458100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47738 (local address 127.27.217.60:34415)
0809 16:16:12.458146 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.458148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.458155 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:16:12.458174 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.458175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.458191 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.458243 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:12.458345 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.458876 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.459877 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.460257 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.460311 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.460360 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.460461 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.460492 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:12.460541 7956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.458025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.0.0.1:47738)
0809 16:16:12.458069 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.458081 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.458128 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.458257 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.458258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.458259 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:12.458300 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.458301 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.458962 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.458964 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.459797 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.459801 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.460340 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.460341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.460393 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.460397 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.460450 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.460485 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 16:16:12.460881 7182 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260809 16:16:12.461659 7975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b770a5f127d453d8f1ca4ef69319018. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:12.461763 7975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: This master's current role is: LEARNER
W20260809 16:16:12.497884 7697 tablet.cc:2369] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:16:12.593322 7465 tablet.cc:2369] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:12.629886 7973 raft_consensus.cc:482] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:12.630014 7973 raft_consensus.cc:504] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.630380 7973 leader_election.cc:288] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789), 939121d7035044a89ec3c1f0fe8f9d02 (127.27.217.2:45051)
I20260809 16:16:12.633229 7963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.630605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:59679 (local address 127.27.217.3:45789)
0809 16:16:12.630654 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.630655 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.630719 (+ 64us) server_negotiation.cc:407] Connection header received
0809 16:16:12.630782 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.630783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.630793 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.630842 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:12.630974 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.631463 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.632502 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.632929 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.632992 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.633002 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.633117 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.633159 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:12.633251 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.630541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:45789 (local address 127.27.217.1:59679)
0809 16:16:12.630638 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.630649 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.630723 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.630846 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.630847 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.630849 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:12.630918 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.630920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.631536 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.631537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.632423 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.632425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.633001 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.633002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.633058 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.633062 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.633102 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.633137 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":52,"thread_start_us":52,"threads_started":1}
I20260809 16:16:12.633268 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.630685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:49795 (local address 127.27.217.2:45051)
0809 16:16:12.630730 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.630732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.630742 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:12.630814 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.630814 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.630823 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.630860 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:12.630991 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.631467 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.632520 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.632939 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.633003 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.633012 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.633152 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.633193 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 16:16:12.633266 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.630560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:45051 (local address 127.27.217.1:49795)
0809 16:16:12.630692 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:12.630701 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:12.630754 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:12.630884 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:12.630884 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:12.630886 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:12.630932 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.630933 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.631536 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.631537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.632438 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:12.632440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.633013 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.633014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:12.633084 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.633089 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:16:12.633140 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 16:16:12.633177 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":20,"thread_start_us":61,"threads_started":1}
I20260809 16:16:12.633623 7845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e5f6b1094d46c4b115f7cae46a1331" candidate_uuid: "42d3859f811f4e8a9b684359edcf26cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" is_pre_election: true
I20260809 16:16:12.633661 7618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e5f6b1094d46c4b115f7cae46a1331" candidate_uuid: "42d3859f811f4e8a9b684359edcf26cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "939121d7035044a89ec3c1f0fe8f9d02" is_pre_election: true
I20260809 16:16:12.633785 7845 raft_consensus.cc:2454] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d3859f811f4e8a9b684359edcf26cf in term 0.
I20260809 16:16:12.633792 7618 raft_consensus.cc:2454] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d3859f811f4e8a9b684359edcf26cf in term 0.
I20260809 16:16:12.634001 7271 leader_election.cc:302] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d3859f811f4e8a9b684359edcf26cf, 939121d7035044a89ec3c1f0fe8f9d02; no voters:
I20260809 16:16:12.634161 7973 raft_consensus.cc:2781] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:12.634200 7973 raft_consensus.cc:482] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:12.634222 7973 raft_consensus.cc:3037] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:12.634966 7973 raft_consensus.cc:504] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.635090 7973 leader_election.cc:288] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [CANDIDATE]: Term 1 election: Requested vote from peers ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789), 939121d7035044a89ec3c1f0fe8f9d02 (127.27.217.2:45051)
I20260809 16:16:12.635214 7845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e5f6b1094d46c4b115f7cae46a1331" candidate_uuid: "42d3859f811f4e8a9b684359edcf26cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2"
I20260809 16:16:12.635226 7618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e5f6b1094d46c4b115f7cae46a1331" candidate_uuid: "42d3859f811f4e8a9b684359edcf26cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "939121d7035044a89ec3c1f0fe8f9d02"
I20260809 16:16:12.635293 7845 raft_consensus.cc:3037] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:12.635308 7618 raft_consensus.cc:3037] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:12.636066 7618 raft_consensus.cc:2454] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d3859f811f4e8a9b684359edcf26cf in term 1.
I20260809 16:16:12.636080 7845 raft_consensus.cc:2454] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d3859f811f4e8a9b684359edcf26cf in term 1.
I20260809 16:16:12.636250 7270 leader_election.cc:302] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d3859f811f4e8a9b684359edcf26cf, ee4dff17d0a741d1a12bd0ea148cd3c2; no voters:
I20260809 16:16:12.636338 7973 raft_consensus.cc:2781] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:12.636435 7973 raft_consensus.cc:686] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 1 LEADER]: Becoming Leader. State: Replica: 42d3859f811f4e8a9b684359edcf26cf, State: Running, Role: LEADER
I20260809 16:16:12.636536 7973 consensus_queue.cc:237] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } }
I20260809 16:16:12.637292 5845 catalog_manager.cc:5495] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 42d3859f811f4e8a9b684359edcf26cf (127.27.217.1). New cstate: current_term: 1 leader_uuid: "42d3859f811f4e8a9b684359edcf26cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260809 16:16:12.637871 7948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: NON_VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: true } } }
I20260809 16:16:12.637979 7948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:12.638485 7946 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: attempting to promote NON_VOTER 1841544938764c7b8b12a520b0a8f78b to VOTER
W20260809 16:16:12.638608 7925 tablet.cc:2369] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:12.638616 7946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } }
I20260809 16:16:12.638952 7182 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 LEARNER]: Refusing update from remote peer 2b770a5f127d453d8f1ca4ef69319018: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260809 16:16:12.638988 6870 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Refusing update from remote peer 2b770a5f127d453d8f1ca4ef69319018: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260809 16:16:12.639146 7948 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260809 16:16:12.639261 7953 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260809 16:16:12.639909 7948 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 1841544938764c7b8b12a520b0a8f78b (127.27.217.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:12.640085 6870 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 1841544938764c7b8b12a520b0a8f78b (127.27.217.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:12.640688 7948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:12.640723 7946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:12.640767 7948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:12.640775 7946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:12.640813 7948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:12.640854 7948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:12.641047 7989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:12.641193 7989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:16:12.641206 7182 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 1841544938764c7b8b12a520b0a8f78b (127.27.217.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:12.642266 7975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2b770a5f127d453d8f1ca4ef69319018" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:12.642349 7975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:16:12.694998 7959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.692625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43254 (local address 127.27.217.1:34137)
0809 16:16:12.692678 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.692680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.692689 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:12.692727 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.692728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.692746 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.692807 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:12.692956 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.693493 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.694247 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.694467 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.694521 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.694678 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:12.694783 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:12.694875 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.694898 (+ 23us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.694921 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:16:12.696895 7845 raft_consensus.cc:1261] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 1 FOLLOWER]: Refusing update from remote peer 42d3859f811f4e8a9b684359edcf26cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:12.696925 7618 raft_consensus.cc:1261] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 FOLLOWER]: Refusing update from remote peer 42d3859f811f4e8a9b684359edcf26cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:12.697261 7985 consensus_queue.cc:1035] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:12.697408 7973 consensus_queue.cc:1035] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:12.700325 7991 mvcc.cc:205] Tried to move back new op lower bound from 7316652739363762176 to 7316652739119865856. Current Snapshot: MvccSnapshot[applied={T|T < 7316652739363762176}]
I20260809 16:16:12.703321 5847 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57036:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:12.703418 5847 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57036:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:12.705281 5847 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b770a5f127d453d8f1ca4ef69319018: Sending DeleteTablet for 3 replicas of tablet c8e5f6b1094d46c4b115f7cae46a1331
I20260809 16:16:12.705612 7584 tablet_service.cc:1514] Processing DeleteTablet for tablet c8e5f6b1094d46c4b115f7cae46a1331 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:12 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:38290
I20260809 16:16:12.705636 7816 tablet_service.cc:1514] Processing DeleteTablet for tablet c8e5f6b1094d46c4b115f7cae46a1331 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:12 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:56110
I20260809 16:16:12.706054 7352 tablet_service.cc:1514] Processing DeleteTablet for tablet c8e5f6b1094d46c4b115f7cae46a1331 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:12 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:43238
I20260809 16:16:12.706282 8014 tablet_replica.cc:330] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: stopping tablet replica
I20260809 16:16:12.706285 8013 tablet_replica.cc:330] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: stopping tablet replica
I20260809 16:16:12.706390 8013 raft_consensus.cc:2229] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:12.706420 8014 raft_consensus.cc:2229] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:12.706508 8013 raft_consensus.cc:2258] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:12.706645 8014 raft_consensus.cc:2258] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:12.706664 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 5787
I20260809 16:16:12.706977 8013 ts_tablet_manager.cc:1905] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:12.709357 8013 ts_tablet_manager.cc:1918] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:12.709434 8013 log.cc:1196] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/c8e5f6b1094d46c4b115f7cae46a1331
I20260809 16:16:12.709712 8013 ts_tablet_manager.cc:1939] T c8e5f6b1094d46c4b115f7cae46a1331 P ee4dff17d0a741d1a12bd0ea148cd3c2: Deleting consensus metadata
I20260809 16:16:12.715235 8014 ts_tablet_manager.cc:1905] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:12.716214 8012 tablet_replica.cc:330] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: stopping tablet replica
I20260809 16:16:12.716367 8012 raft_consensus.cc:2229] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:12.716499 8012 raft_consensus.cc:2258] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:12.717528 8014 ts_tablet_manager.cc:1918] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:12.717617 8014 log.cc:1196] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/c8e5f6b1094d46c4b115f7cae46a1331
I20260809 16:16:12.717892 8014 ts_tablet_manager.cc:1939] T c8e5f6b1094d46c4b115f7cae46a1331 P 42d3859f811f4e8a9b684359edcf26cf: Deleting consensus metadata
I20260809 16:16:12.718588 8012 ts_tablet_manager.cc:1905] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:12.720297 8012 ts_tablet_manager.cc:1918] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:12.720382 8012 log.cc:1196] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/c8e5f6b1094d46c4b115f7cae46a1331
I20260809 16:16:12.720645 8012 ts_tablet_manager.cc:1939] T c8e5f6b1094d46c4b115f7cae46a1331 P 939121d7035044a89ec3c1f0fe8f9d02: Deleting consensus metadata
W20260809 16:16:12.722321 7500 connection.cc:535] server connection from 127.0.0.1:38290 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 16:16:12.722478 7273 connection.cc:535] server connection from 127.0.0.1:43238 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 16:16:12.722524 7730 connection.cc:535] server connection from 127.0.0.1:56110 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 16:16:12.731846 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.724254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36000 (local address 127.27.217.61:35753)
0809 16:16:12.724301 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.724302 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.724501 (+ 199us) server_negotiation.cc:407] Connection header received
0809 16:16:12.724571 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.724572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.724587 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.724644 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.725269 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.726010 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.726795 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.727013 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.727069 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.728949 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.728951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.728951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.728959 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.730480 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.730835 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.730837 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.730837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.730895 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.731120 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.731121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.731121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.731261 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.731369 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.731538 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.731620 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:12.732498 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:12.724417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47752 (local address 127.27.217.60:34415)
0809 16:16:12.724462 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:12.724463 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:12.724649 (+ 186us) server_negotiation.cc:407] Connection header received
0809 16:16:12.724736 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:12.724737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:12.724748 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:12.724835 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:12.725457 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.726178 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.727243 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:12.727484 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:12.727541 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:12.728928 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:12.728930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:12.728930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:12.728937 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:12.730715 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.731070 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.731071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.731071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.731133 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:12.731319 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:12.731319 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:12.731320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:12.731447 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:12.731539 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:12.732303 (+ 764us) server_negotiation.cc:299] Negotiation successful
0809 16:16:12.732387 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:16:13.701752 8036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:13.701477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:45313)
0809 16:16:13.701598 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:13.701691 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
W20260809 16:16:13.702057 7695 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:41665 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:13.703050 8037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:13.702815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:54027)
0809 16:16:13.702936 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:13.703010 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":51,"threads_started":1}
W20260809 16:16:13.703229 7921 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:41665 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:13.704291 8040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:13.704072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:33337)
0809 16:16:13.704175 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:13.704247 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":51,"threads_started":1}
W20260809 16:16:13.704455 7462 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:41665 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:14.205921 8041 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b770a5f127d453d8f1ca4ef69319018)
I20260809 16:16:14.205931 8043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b770a5f127d453d8f1ca4ef69319018)
I20260809 16:16:14.206014 8041 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } }
I20260809 16:16:14.206076 8043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } }
I20260809 16:16:14.206202 8041 leader_election.cc:288] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665), 1841544938764c7b8b12a520b0a8f78b (127.27.217.60:34415)
I20260809 16:16:14.206395 8043 leader_election.cc:288] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665), 8c72c0139d6140d9b4f4ecbe2c5adaef (127.27.217.61:35753)
I20260809 16:16:14.206725 8049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.206342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57452)
0809 16:16:14.206616 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.206678 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":51,"threads_started":1}
I20260809 16:16:14.206746 8046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.206470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57464)
0809 16:16:14.206582 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.206705 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":51,"threads_started":1}
W20260809 16:16:14.206866 7142 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
W20260809 16:16:14.206969 6828 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:14.207373 8046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.207275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57470)
0809 16:16:14.207325 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.207348 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 16:16:14.207386 8049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.207287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57478)
0809 16:16:14.207322 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.207346 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260809 16:16:14.207465 6828 leader_election.cc:334] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665): Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
W20260809 16:16:14.207533 7142 leader_election.cc:334] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665): Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:14.210255 8047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.206506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:35753 (local address 127.0.0.1:36010)
0809 16:16:14.206625 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.206636 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:14.206696 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:14.206976 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:14.206977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:14.206979 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:14.207049 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:14.207051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:14.207946 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:14.207947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:14.209224 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:14.209227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:14.209978 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:14.209979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:14.210066 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:14.210069 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:14.210112 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:16:14.210156 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":45,"thread_start_us":36,"threads_started":1}
I20260809 16:16:14.210254 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.206500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34415 (local address 127.0.0.1:47766)
0809 16:16:14.206827 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.206836 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:14.206935 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:14.207128 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:14.207129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:14.207130 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:14.207256 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:14.207259 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:14.208063 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:14.208064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:14.209224 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:14.209227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:14.209978 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:14.209979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:14.210056 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:14.210060 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:14.210115 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 16:16:14.210156 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":55,"thread_start_us":53,"threads_started":1}
I20260809 16:16:14.210265 8052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.206616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36010 (local address 127.27.217.61:35753)
0809 16:16:14.206826 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:14.206828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:14.206835 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:16:14.206862 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:14.206863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:14.206874 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:14.207110 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:14.207148 (+ 38us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:14.207873 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:14.209315 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:14.209910 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:14.209972 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:14.209984 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:14.210132 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 16:16:14.210172 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":156,"thread_start_us":41,"threads_started":1}
I20260809 16:16:14.210265 8054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.206697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47766 (local address 127.27.217.60:34415)
0809 16:16:14.206786 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:14.206788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:14.206906 (+ 118us) server_negotiation.cc:407] Connection header received
0809 16:16:14.207004 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:14.207005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:14.207016 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:14.207061 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:14.207342 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:14.208000 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:14.209333 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:14.209897 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:14.209972 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:14.209984 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:14.210125 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 16:16:14.210166 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":73,"thread_start_us":48,"threads_started":1}
I20260809 16:16:14.210676 6870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1841544938764c7b8b12a520b0a8f78b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" is_pre_election: true
I20260809 16:16:14.210680 7182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1841544938764c7b8b12a520b0a8f78b" is_pre_election: true
I20260809 16:16:14.210762 7182 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c72c0139d6140d9b4f4ecbe2c5adaef in term 1.
I20260809 16:16:14.210764 6870 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1841544938764c7b8b12a520b0a8f78b in term 1.
I20260809 16:16:14.210880 6828 leader_election.cc:302] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1841544938764c7b8b12a520b0a8f78b, 8c72c0139d6140d9b4f4ecbe2c5adaef; no voters: 2b770a5f127d453d8f1ca4ef69319018
I20260809 16:16:14.210911 7146 leader_election.cc:302] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1841544938764c7b8b12a520b0a8f78b, 8c72c0139d6140d9b4f4ecbe2c5adaef; no voters: 2b770a5f127d453d8f1ca4ef69319018
I20260809 16:16:14.210968 8041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 16:16:14.211017 8041 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b770a5f127d453d8f1ca4ef69319018)
I20260809 16:16:14.211037 8041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 1 FOLLOWER]: Advancing to term 2
I20260809 16:16:14.211023 8043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 16:16:14.211062 8043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b770a5f127d453d8f1ca4ef69319018)
I20260809 16:16:14.211090 8043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 1 FOLLOWER]: Advancing to term 2
I20260809 16:16:14.211942 8043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } }
I20260809 16:16:14.211942 8041 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } }
I20260809 16:16:14.212069 8041 leader_election.cc:288] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 2 election: Requested vote from peers 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665), 1841544938764c7b8b12a520b0a8f78b (127.27.217.60:34415)
I20260809 16:16:14.212075 8043 leader_election.cc:288] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [CANDIDATE]: Term 2 election: Requested vote from peers 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665), 8c72c0139d6140d9b4f4ecbe2c5adaef (127.27.217.61:35753)
I20260809 16:16:14.212199 6870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1841544938764c7b8b12a520b0a8f78b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef"
I20260809 16:16:14.212224 8047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.212145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57494)
0809 16:16:14.212174 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.212199 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260809 16:16:14.212273 6870 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1841544938764c7b8b12a520b0a8f78b in current term 2: Already voted for candidate 8c72c0139d6140d9b4f4ecbe2c5adaef in this term.
I20260809 16:16:14.212335 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.212235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57506)
0809 16:16:14.212285 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.212315 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 16:16:14.212373 7182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1841544938764c7b8b12a520b0a8f78b"
I20260809 16:16:14.212450 7182 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c72c0139d6140d9b4f4ecbe2c5adaef in current term 2: Already voted for candidate 1841544938764c7b8b12a520b0a8f78b in this term.
I20260809 16:16:14.212479 8047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.212396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57514)
0809 16:16:14.212430 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.212458 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260809 16:16:14.212600 7142 leader_election.cc:334] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665): Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:14.212674 7142 leader_election.cc:302] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1841544938764c7b8b12a520b0a8f78b; no voters: 2b770a5f127d453d8f1ca4ef69319018, 8c72c0139d6140d9b4f4ecbe2c5adaef
I20260809 16:16:14.212764 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.212686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:57518)
0809 16:16:14.212717 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.212744 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260809 16:16:14.212770 8043 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260809 16:16:14.212826 6828 leader_election.cc:334] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665): Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:14.212870 6828 leader_election.cc:302] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c72c0139d6140d9b4f4ecbe2c5adaef; no voters: 1841544938764c7b8b12a520b0a8f78b, 2b770a5f127d453d8f1ca4ef69319018
I20260809 16:16:14.212934 8041 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 16:16:14.702666 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.702423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:44881)
0809 16:16:14.702560 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.702608 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260809 16:16:14.703708 8062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.703474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:59021)
0809 16:16:14.703599 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.703640 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":65,"threads_started":1}
I20260809 16:16:14.704861 8064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:14.704689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:43981)
0809 16:16:14.704792 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:14.704825 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":58,"threads_started":1}
I20260809 16:16:15.703447 8068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.703203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:42569)
0809 16:16:15.703347 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.703390 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260809 16:16:15.704242 8069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.704062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:35513)
0809 16:16:15.704163 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.704199 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":51,"threads_started":1}
I20260809 16:16:15.705391 8072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.705198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:51343)
0809 16:16:15.705298 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.705336 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":47,"threads_started":1}
I20260809 16:16:15.928931 8073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:15.929026 8073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } }
I20260809 16:16:15.929190 8073 leader_election.cc:288] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665), 1841544938764c7b8b12a520b0a8f78b (127.27.217.60:34415)
I20260809 16:16:15.929527 8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.929327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:49060)
0809 16:16:15.929423 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.929480 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":46,"threads_started":1}
I20260809 16:16:15.929592 7182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1841544938764c7b8b12a520b0a8f78b" is_pre_election: true
I20260809 16:16:15.929697 7182 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c72c0139d6140d9b4f4ecbe2c5adaef in term 2.
I20260809 16:16:15.929913 6828 leader_election.cc:302] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1841544938764c7b8b12a520b0a8f78b, 8c72c0139d6140d9b4f4ecbe2c5adaef; no voters:
I20260809 16:16:15.929965 8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.929867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:49072)
0809 16:16:15.929912 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.929941 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 16:16:15.930001 8073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 16:16:15.930035 8073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:15.930063 8073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 2 FOLLOWER]: Advancing to term 3
W20260809 16:16:15.930064 6828 leader_election.cc:334] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665): Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:15.930799 8073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } }
I20260809 16:16:15.930902 8073 leader_election.cc:288] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 3 election: Requested vote from peers 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665), 1841544938764c7b8b12a520b0a8f78b (127.27.217.60:34415)
I20260809 16:16:15.931083 8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.930999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:49076)
0809 16:16:15.931040 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.931065 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 16:16:15.931167 7182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1841544938764c7b8b12a520b0a8f78b"
I20260809 16:16:15.931244 7182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 2 FOLLOWER]: Advancing to term 3
I20260809 16:16:15.931445 8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.931350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:49088)
0809 16:16:15.931396 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.931424 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:16:15.931507 6828 leader_election.cc:334] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665): Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
I20260809 16:16:15.932072 7182 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c72c0139d6140d9b4f4ecbe2c5adaef in term 3.
I20260809 16:16:15.932246 6828 leader_election.cc:302] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1841544938764c7b8b12a520b0a8f78b, 8c72c0139d6140d9b4f4ecbe2c5adaef; no voters: 2b770a5f127d453d8f1ca4ef69319018
I20260809 16:16:15.932323 8073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 3 FOLLOWER]: Leader election won for term 3
I20260809 16:16:15.932456 8073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [term 3 LEADER]: Becoming Leader. State: Replica: 8c72c0139d6140d9b4f4ecbe2c5adaef, State: Running, Role: LEADER
I20260809 16:16:15.932533 8073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } }
I20260809 16:16:15.932880 8080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c72c0139d6140d9b4f4ecbe2c5adaef. Latest consensus state: current_term: 3 leader_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:15.932961 8080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:15.933122 8082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:15.933519 8082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:15.933598 8082 catalog_manager.cc:1259] Loaded cluster ID: 3d0e61d153e2458d8bfbee767b8cbfa8
I20260809 16:16:15.933629 8082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:15.933825 8082 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:15.933892 8082 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Loaded TSK: 0
I20260809 16:16:15.934033 8082 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:16:15.969909 6852 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:15.971589 6852 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:15.972633 7182 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [term 3 FOLLOWER]: Refusing update from remote peer 8c72c0139d6140d9b4f4ecbe2c5adaef: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 16:16:15.972643 8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.972538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:49106)
0809 16:16:15.972590 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.972618 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 16:16:15.972841 8080 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260809 16:16:15.972976 8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.972895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.0.0.1:49120)
0809 16:16:15.972932 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.972956 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 16:16:15.973055 6828 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef -> Peer 2b770a5f127d453d8f1ca4ef69319018 (127.27.217.62:41665): Couldn't send request to peer 2b770a5f127d453d8f1ca4ef69319018. Status: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 16:16:15.973389 8086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c72c0139d6140d9b4f4ecbe2c5adaef. Latest consensus state: current_term: 3 leader_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:15.973474 8086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:16:15.973809 8085 mvcc.cc:205] Tried to move back new op lower bound from 7316652752782073856 to 7316652752620314624. Current Snapshot: MvccSnapshot[applied={T|T < 7316652752782073856}]
I20260809 16:16:15.973925 8080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:15.974014 8080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:15.974267 8086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "2b770a5f127d453d8f1ca4ef69319018" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41665 } } peers { permanent_uuid: "8c72c0139d6140d9b4f4ecbe2c5adaef" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 35753 } attrs { promote: false } } peers { permanent_uuid: "1841544938764c7b8b12a520b0a8f78b" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34415 } attrs { promote: false } } }
I20260809 16:16:15.974387 8086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1841544938764c7b8b12a520b0a8f78b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:16:15.978924 8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.975583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:45051 (local address 127.0.0.1:53152)
0809 16:16:15.975623 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.975632 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:15.975698 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:15.976135 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:15.976136 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:15.976137 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:15.976163 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:15.976164 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.977111 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.977112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:15.977916 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:15.977918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.978653 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.978654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:15.978749 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:15.978755 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 16:16:15.978826 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:16:15.978864 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":2}
I20260809 16:16:15.979107 8097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.975630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:45789 (local address 127.0.0.1:56066)
0809 16:16:15.975894 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.975904 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:15.975947 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:15.976105 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:15.976106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:15.976108 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:15.976161 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:15.976163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.977063 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.977064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:15.978178 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:15.978181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.978891 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.978892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:15.978954 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:15.978959 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:16:15.978988 (+ 29us) client_negotiation.cc:240] Negotiation successful
0809 16:16:15.979033 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":64,"thread_start_us":84,"threads_started":1}
I20260809 16:16:15.979192 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.975787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53152 (local address 127.27.217.2:45051)
0809 16:16:15.975993 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:15.975996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:15.976003 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:16:15.976025 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:15.976025 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:15.976034 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:15.976131 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:15.976209 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.977023 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.978019 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.978551 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.978622 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:15.978638 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:15.979075 (+ 437us) server_negotiation.cc:299] Negotiation successful
0809 16:16:15.979124 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":55,"threads_started":1}
I20260809 16:16:15.979411 8100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.975824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56066 (local address 127.27.217.3:45789)
0809 16:16:15.975950 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:15.975952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:15.975964 (+ 12us) server_negotiation.cc:407] Connection header received
0809 16:16:15.976009 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:15.976010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:15.976021 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:15.976090 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:15.976217 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.976964 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.978273 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.978803 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.979259 (+ 456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:15.979274 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:15.979293 (+ 19us) server_negotiation.cc:299] Negotiation successful
0809 16:16:15.979332 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":68,"threads_started":1}
I20260809 16:16:15.979559 7584 tablet_service.cc:1467] Processing CreateTablet for tablet 77e54927110f4187a016afa92c54ebaa (DEFAULT_TABLE table=test-table [id=89a2a03234894755b8cd4d798538aaf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:15.979724 7584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e54927110f4187a016afa92c54ebaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:15.980108 7816 tablet_service.cc:1467] Processing CreateTablet for tablet 77e54927110f4187a016afa92c54ebaa (DEFAULT_TABLE table=test-table [id=89a2a03234894755b8cd4d798538aaf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:15.980232 7816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e54927110f4187a016afa92c54ebaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:15.980826 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.975637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:34137 (local address 127.0.0.1:46266)
0809 16:16:15.976008 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.976015 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:15.976053 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:15.976342 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:15.976343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:15.976344 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:15.976392 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:15.976393 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.977044 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.977045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:15.979844 (+ 2799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:15.979848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.980606 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.980607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:15.980667 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:15.980671 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:15.980715 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:15.980760 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":83,"thread_start_us":98,"threads_started":1}
I20260809 16:16:15.981096 8102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.975881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46266 (local address 127.27.217.1:34137)
0809 16:16:15.975989 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:15.975990 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:15.976046 (+ 56us) server_negotiation.cc:407] Connection header received
0809 16:16:15.976236 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:15.976237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:15.976247 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:15.976297 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:15.976464 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.976971 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.979941 (+ 2970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:15.980484 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:15.980552 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:15.980566 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:15.980967 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 16:16:15.981026 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":57,"threads_started":1}
I20260809 16:16:15.981330 7352 tablet_service.cc:1467] Processing CreateTablet for tablet 77e54927110f4187a016afa92c54ebaa (DEFAULT_TABLE table=test-table [id=89a2a03234894755b8cd4d798538aaf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:15.981444 7352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e54927110f4187a016afa92c54ebaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:15.981658 8108 tablet_bootstrap.cc:492] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: Bootstrap starting.
I20260809 16:16:15.981729 8107 tablet_bootstrap.cc:492] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: Bootstrap starting.
I20260809 16:16:15.982100 8107 tablet_bootstrap.cc:654] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:15.982095 8108 tablet_bootstrap.cc:654] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:15.982769 8107 tablet_bootstrap.cc:492] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: No bootstrap required, opened a new log
I20260809 16:16:15.982769 8108 tablet_bootstrap.cc:492] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: No bootstrap required, opened a new log
I20260809 16:16:15.982821 8108 ts_tablet_manager.cc:1397] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:15.982889 8107 ts_tablet_manager.cc:1397] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:15.982939 8108 raft_consensus.cc:348] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:15.983001 8108 raft_consensus.cc:374] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:15.983021 8108 raft_consensus.cc:729] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4dff17d0a741d1a12bd0ea148cd3c2, State: Initialized, Role: FOLLOWER
I20260809 16:16:15.983058 8108 consensus_queue.cc:260] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:15.983177 8107 raft_consensus.cc:348] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:15.983223 8108 ts_tablet_manager.cc:1428] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:15.983245 8107 raft_consensus.cc:374] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:15.983263 8107 raft_consensus.cc:729] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 939121d7035044a89ec3c1f0fe8f9d02, State: Initialized, Role: FOLLOWER
I20260809 16:16:15.983394 8107 consensus_queue.cc:260] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:15.983556 8069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.983432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:50829)
0809 16:16:15.983504 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.983531 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 16:16:15.983593 8107 ts_tablet_manager.cc:1428] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 16:16:15.983923 8068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.983820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:47051)
0809 16:16:15.983860 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.983894 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 16:16:15.984220 8068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.984129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:33683)
0809 16:16:15.984173 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.984200 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 16:16:15.984464 7696 heartbeater.cc:503] Master 127.27.217.61:35753 was elected leader, sending a full tablet report...
I20260809 16:16:15.985288 8069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.985173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:48649)
0809 16:16:15.985239 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.985263 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 16:16:15.985453 7923 heartbeater.cc:503] Master 127.27.217.61:35753 was elected leader, sending a full tablet report...
I20260809 16:16:15.987350 8113 tablet_bootstrap.cc:492] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf: Bootstrap starting.
I20260809 16:16:15.987870 8113 tablet_bootstrap.cc:654] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:15.989171 8113 tablet_bootstrap.cc:492] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf: No bootstrap required, opened a new log
I20260809 16:16:15.989230 8113 ts_tablet_manager.cc:1397] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:15.989382 8113 raft_consensus.cc:348] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:15.989472 8113 raft_consensus.cc:374] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:15.989493 8113 raft_consensus.cc:729] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d3859f811f4e8a9b684359edcf26cf, State: Initialized, Role: FOLLOWER
I20260809 16:16:15.989576 8113 consensus_queue.cc:260] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:15.989741 8113 ts_tablet_manager.cc:1428] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:15.989991 8072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.989900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:51447)
0809 16:16:15.989936 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.989963 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260809 16:16:15.990221 7464 heartbeater.cc:503] Master 127.27.217.61:35753 was elected leader, sending a full tablet report...
I20260809 16:16:15.990374 8072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:15.990284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:49577)
0809 16:16:15.990316 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:15.990340 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260809 16:16:16.025089 8118 raft_consensus.cc:482] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:16.025187 8118 raft_consensus.cc:504] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:16.025533 8118 leader_election.cc:288] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789), 42d3859f811f4e8a9b684359edcf26cf (127.27.217.1:34137)
I20260809 16:16:16.028837 8068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.025670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:45789 (local address 127.27.217.2:47463)
0809 16:16:16.025720 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.025733 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:16.025800 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:16.025999 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:16.026000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:16.026003 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:16.026064 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:16.026066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.026787 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.026788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:16.027894 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:16.027896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.028625 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.028625 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:16.028699 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:16.028704 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:16:16.028748 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:16.028784 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260809 16:16:16.029071 8100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.025735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:47463 (local address 127.27.217.3:45789)
0809 16:16:16.025781 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:16.025782 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:16.025791 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:16.025891 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:16.025893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:16.025902 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:16.025945 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:16.026138 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.026720 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.027968 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.028533 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.028610 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:16.028621 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:16.028984 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 16:16:16.029024 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:16:16.029266 8102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.025962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:42089 (local address 127.27.217.1:34137)
0809 16:16:16.026010 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:16.026012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:16.026111 (+ 99us) server_negotiation.cc:407] Connection header received
0809 16:16:16.026197 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:16.026198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:16.026207 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:16.026233 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:16.026412 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.027142 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.028262 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.028655 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.028718 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:16.028727 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:16.029132 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 16:16:16.029191 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 16:16:16.029246 7845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e54927110f4187a016afa92c54ebaa" candidate_uuid: "939121d7035044a89ec3c1f0fe8f9d02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" is_pre_election: true
I20260809 16:16:16.029320 7845 raft_consensus.cc:2454] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 939121d7035044a89ec3c1f0fe8f9d02 in term 0.
I20260809 16:16:16.029488 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.025896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:34137 (local address 127.27.217.2:42089)
0809 16:16:16.026059 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.026068 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:16.026133 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:16.026293 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:16.026294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:16.026295 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:16.026352 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:16.026353 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.027227 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.027229 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:16.028191 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:16.028194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.028738 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.028739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:16.028829 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:16.028834 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:16:16.029361 (+ 527us) client_negotiation.cc:240] Negotiation successful
0809 16:16:16.029405 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":86,"threads_started":1}
I20260809 16:16:16.029505 7499 leader_election.cc:302] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 939121d7035044a89ec3c1f0fe8f9d02, ee4dff17d0a741d1a12bd0ea148cd3c2; no voters:
I20260809 16:16:16.029681 8118 raft_consensus.cc:2781] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:16.029721 8118 raft_consensus.cc:482] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:16.029742 8118 raft_consensus.cc:3037] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:16.029847 7386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e54927110f4187a016afa92c54ebaa" candidate_uuid: "939121d7035044a89ec3c1f0fe8f9d02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d3859f811f4e8a9b684359edcf26cf" is_pre_election: true
I20260809 16:16:16.029989 7386 raft_consensus.cc:2454] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 939121d7035044a89ec3c1f0fe8f9d02 in term 0.
I20260809 16:16:16.030530 8118 raft_consensus.cc:504] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:16.030647 8118 leader_election.cc:288] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [CANDIDATE]: Term 1 election: Requested vote from peers ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789), 42d3859f811f4e8a9b684359edcf26cf (127.27.217.1:34137)
I20260809 16:16:16.030817 7845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e54927110f4187a016afa92c54ebaa" candidate_uuid: "939121d7035044a89ec3c1f0fe8f9d02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2"
I20260809 16:16:16.030850 7386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e54927110f4187a016afa92c54ebaa" candidate_uuid: "939121d7035044a89ec3c1f0fe8f9d02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d3859f811f4e8a9b684359edcf26cf"
I20260809 16:16:16.030905 7845 raft_consensus.cc:3037] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:16.030925 7386 raft_consensus.cc:3037] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:16.031541 7386 raft_consensus.cc:2454] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 939121d7035044a89ec3c1f0fe8f9d02 in term 1.
I20260809 16:16:16.031739 7501 leader_election.cc:302] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d3859f811f4e8a9b684359edcf26cf, 939121d7035044a89ec3c1f0fe8f9d02; no voters:
I20260809 16:16:16.031739 7845 raft_consensus.cc:2454] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 939121d7035044a89ec3c1f0fe8f9d02 in term 1.
I20260809 16:16:16.031824 8118 raft_consensus.cc:2781] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:16.031952 8118 raft_consensus.cc:686] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 LEADER]: Becoming Leader. State: Replica: 939121d7035044a89ec3c1f0fe8f9d02, State: Running, Role: LEADER
I20260809 16:16:16.032023 8118 consensus_queue.cc:237] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } }
I20260809 16:16:16.032658 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.032576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:45597)
0809 16:16:16.032606 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.032633 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260809 16:16:16.032743 6852 catalog_manager.cc:5495] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 939121d7035044a89ec3c1f0fe8f9d02 (127.27.217.2). New cstate: current_term: 1 leader_uuid: "939121d7035044a89ec3c1f0fe8f9d02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "939121d7035044a89ec3c1f0fe8f9d02" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260809 16:16:16.040771 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.038553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53158 (local address 127.27.217.2:45051)
0809 16:16:16.038594 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:16.038596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:16.038604 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:16.038664 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:16.038664 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:16.038682 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:16.038740 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:16.038870 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.039313 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.040117 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:16.040306 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:16.040356 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:16.040502 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:16.040592 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:16.040651 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:16.040696 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 16:16:16.040715 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:16:16.041622 7845 raft_consensus.cc:1261] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 1 FOLLOWER]: Refusing update from remote peer 939121d7035044a89ec3c1f0fe8f9d02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:16.041688 7386 raft_consensus.cc:1261] T 77e54927110f4187a016afa92c54ebaa P 42d3859f811f4e8a9b684359edcf26cf [term 1 FOLLOWER]: Refusing update from remote peer 939121d7035044a89ec3c1f0fe8f9d02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:16.041867 8127 consensus_queue.cc:1035] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee4dff17d0a741d1a12bd0ea148cd3c2" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:16.041985 8118 consensus_queue.cc:1035] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d3859f811f4e8a9b684359edcf26cf" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:16.042932 8069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.042707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:58971)
0809 16:16:16.042863 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.042900 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260809 16:16:16.043401 8133 mvcc.cc:205] Tried to move back new op lower bound from 7316652753064730624 to 7316652753027809280. Current Snapshot: MvccSnapshot[applied={T|T < 7316652753064730624}]
I20260809 16:16:16.043463 8072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.043125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:46531)
0809 16:16:16.043399 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.043433 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255}
I20260809 16:16:16.044276 8072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.044190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.1:57641)
0809 16:16:16.044221 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.044250 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260809 16:16:16.044520 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.044434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:39537)
0809 16:16:16.044469 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.044498 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260809 16:16:16.045233 8124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.045157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.2:47175)
0809 16:16:16.045183 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.045207 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
I20260809 16:16:16.045691 8134 mvcc.cc:205] Tried to move back new op lower bound from 7316652753064730624 to 7316652753027809280. Current Snapshot: MvccSnapshot[applied={T|T < 7316652753064730624 or (T in {7316652753064730624})}]
I20260809 16:16:16.045847 8069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.045733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41665 (local address 127.27.217.3:60947)
0809 16:16:16.045794 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.045818 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:41665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 16:16:16.047400 6852 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:16.047473 6852 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:16.048861 6852 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8c72c0139d6140d9b4f4ecbe2c5adaef: Sending DeleteTablet for 3 replicas of tablet 77e54927110f4187a016afa92c54ebaa
I20260809 16:16:16.049139 7584 tablet_service.cc:1514] Processing DeleteTablet for tablet 77e54927110f4187a016afa92c54ebaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:16 UTC) from {username='oryx', principal='oryx/127.27.217.61@KRBTEST.COM'} at 127.0.0.1:53152
I20260809 16:16:16.049149 7352 tablet_service.cc:1514] Processing DeleteTablet for tablet 77e54927110f4187a016afa92c54ebaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:16 UTC) from {username='oryx', principal='oryx/127.27.217.61@KRBTEST.COM'} at 127.0.0.1:46266
I20260809 16:16:16.049306 7816 tablet_service.cc:1514] Processing DeleteTablet for tablet 77e54927110f4187a016afa92c54ebaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:16 UTC) from {username='oryx', principal='oryx/127.27.217.61@KRBTEST.COM'} at 127.0.0.1:56066
I20260809 16:16:16.049494 8152 tablet_replica.cc:330] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: stopping tablet replica
I20260809 16:16:16.049572 8148 tablet_replica.cc:330] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: stopping tablet replica
I20260809 16:16:16.049621 8148 raft_consensus.cc:2229] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:16.049592 8152 raft_consensus.cc:2229] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:16.049703 8148 raft_consensus.cc:2258] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:16.049794 8152 raft_consensus.cc:2258] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:16.049819 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 7248
I20260809 16:16:16.050005 8148 ts_tablet_manager.cc:1905] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:16.051638 8148 ts_tablet_manager.cc:1918] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:16.051708 8148 log.cc:1196] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/77e54927110f4187a016afa92c54ebaa
I20260809 16:16:16.051925 8148 ts_tablet_manager.cc:1939] T 77e54927110f4187a016afa92c54ebaa P 939121d7035044a89ec3c1f0fe8f9d02: Deleting consensus metadata
I20260809 16:16:16.052199 6830 catalog_manager.cc:4841] TS 939121d7035044a89ec3c1f0fe8f9d02 (127.27.217.2:45051): tablet 77e54927110f4187a016afa92c54ebaa (table test-table [id=89a2a03234894755b8cd4d798538aaf1]) successfully deleted
I20260809 16:16:16.057763 8152 ts_tablet_manager.cc:1905] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:16.061870 8152 ts_tablet_manager.cc:1918] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:16.061926 8152 log.cc:1196] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/77e54927110f4187a016afa92c54ebaa
I20260809 16:16:16.062105 8152 ts_tablet_manager.cc:1939] T 77e54927110f4187a016afa92c54ebaa P ee4dff17d0a741d1a12bd0ea148cd3c2: Deleting consensus metadata
I20260809 16:16:16.062407 6828 catalog_manager.cc:4841] TS ee4dff17d0a741d1a12bd0ea148cd3c2 (127.27.217.3:45789): tablet 77e54927110f4187a016afa92c54ebaa (table test-table [id=89a2a03234894755b8cd4d798538aaf1]) successfully deleted
I20260809 16:16:16.067219 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:16.067066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:34137 (local address 127.0.0.1:46268)
0809 16:16:16.067145 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:16.067179 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:34137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 16:16:16.067270 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 7474
W20260809 16:16:16.067381 6832 catalog_manager.cc:4584] TS 42d3859f811f4e8a9b684359edcf26cf (127.27.217.1:34137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77e54927110f4187a016afa92c54ebaa: Network error: Client connection negotiation failed: client connection to 127.27.217.1:34137: connect: Connection refused (error 111)
I20260809 16:16:16.074905 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 7705
I20260809 16:16:16.085503 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 6631
I20260809 16:16:16.097407 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 6953
2026-08-09T16:16:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6615 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:16 dist-test-slave-nj21 krb5kdc[8155](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:16 dist-test-slave-nj21 krb5kdc[8155](info): set up 2 sockets
Aug 09 16:16:16 dist-test-slave-nj21 krb5kdc[8155](info): commencing operation
krb5kdc: starting...
W20260809 16:16:17.250154 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.62.keytab.
Entry for principal oryx/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.62.keytab.
I20260809 16:16:17.363085 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41929
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.62.keytab
--principal=oryx/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:45003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41929
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:17.442526 8173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:17.442783 8173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:17.442816 8173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:17.443998 8173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:17.444037 8173 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 16:16:17.444056 8173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:17.444070 8173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:17.444087 8173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:17.444105 8173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:17.445585 8173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:45003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41929
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.62.keytab
--principal=oryx/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:17.445819 8173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:17.446026 8173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:17.450537 8182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:17.450640 8173 server_base.cc:1034] running on GCE node
W20260809 16:16:17.450553 8181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:17.450556 8185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:17.450950 8173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:17.451193 8173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:17.452330 8173 hybrid_clock.cc:648] HybridClock initialized: now 1786292177452318 us; error 29 us; skew 500 ppm
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:17.454703 8173 init.cc:377] Logged in from keytab as oryx/127.27.217.62@KRBTEST.COM (short username oryx)
I20260809 16:16:17.455101 8173 webserver.cc:460] Webserver started at http://127.27.217.62:40725/ using document root <none> and password file <none>
I20260809 16:16:17.455313 8173 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:17.455358 8173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:17.455477 8173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:17.456497 8173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "dd1a0d0dd7b242088e3f806bedfc1553"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "fa1a84621d17ea27fb7f65ff53a6cfc3"
server_key_iv: "5ca6f9e551f9d9ff2daa392226465a43"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.456821 8173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "dd1a0d0dd7b242088e3f806bedfc1553"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "fa1a84621d17ea27fb7f65ff53a6cfc3"
server_key_iv: "5ca6f9e551f9d9ff2daa392226465a43"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.458258 8173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:16:17.458902 8199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:17.459056 8173 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:17.459142 8173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "dd1a0d0dd7b242088e3f806bedfc1553"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "fa1a84621d17ea27fb7f65ff53a6cfc3"
server_key_iv: "5ca6f9e551f9d9ff2daa392226465a43"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.459205 8173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:17.476159 8173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:17.478158 8173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:17.478302 8173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:17.483193 8173 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:41929
I20260809 16:16:17.483224 8308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:41929 every 8 connection(s)
I20260809 16:16:17.483553 8173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:17.484207 8311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:17.486445 8311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: Bootstrap starting.
I20260809 16:16:17.487012 8311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:17.487270 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 8173
I20260809 16:16:17.487298 8311 log.cc:824] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:17.487349 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:17.487519 28516 external_mini_cluster.cc:1428] Setting key d030ae48373dc00dd1554fd5798ce5e9
I20260809 16:16:17.487993 8311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: No bootstrap required, opened a new log
I20260809 16:16:17.490419 8311 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a0d0dd7b242088e3f806bedfc1553" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41929 } }
I20260809 16:16:17.490552 8311 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:17.490586 8311 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd1a0d0dd7b242088e3f806bedfc1553, State: Initialized, Role: FOLLOWER
I20260809 16:16:17.490703 8311 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a0d0dd7b242088e3f806bedfc1553" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41929 } }
I20260809 16:16:17.490772 8311 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:17.490801 8311 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:17.490847 8311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:17.491431 8311 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a0d0dd7b242088e3f806bedfc1553" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41929 } }
I20260809 16:16:17.491539 8311 leader_election.cc:302] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd1a0d0dd7b242088e3f806bedfc1553; no voters:
I20260809 16:16:17.491703 8311 leader_election.cc:288] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:17.491731 8319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:17.491869 8319 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [term 1 LEADER]: Becoming Leader. State: Replica: dd1a0d0dd7b242088e3f806bedfc1553, State: Running, Role: LEADER
I20260809 16:16:17.491936 8311 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:17.491961 8319 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a0d0dd7b242088e3f806bedfc1553" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41929 } }
I20260809 16:16:17.492308 8319 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd1a0d0dd7b242088e3f806bedfc1553. Latest consensus state: current_term: 1 leader_uuid: "dd1a0d0dd7b242088e3f806bedfc1553" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a0d0dd7b242088e3f806bedfc1553" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41929 } } }
I20260809 16:16:17.492398 8319 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:17.492641 8328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:17.492321 8322 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd1a0d0dd7b242088e3f806bedfc1553" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd1a0d0dd7b242088e3f806bedfc1553" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41929 } } }
I20260809 16:16:17.493119 8322 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:17.493171 8328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:17.495339 8328 catalog_manager.cc:1347] Generated new cluster ID: 0ae370c9a6724cff99e7f6989338cf2d
I20260809 16:16:17.495383 8328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:17.498981 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.487982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56778 (local address 127.27.217.62:41929)
0809 16:16:17.488159 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.488169 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.488194 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:16:17.489124 (+ 930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.489131 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.489177 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.489283 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.490071 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.491058 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.492107 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.492843 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.492957 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.495618 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:17.495622 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:17.495622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:17.495632 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:17.497448 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.497869 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.497871 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.497872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.497962 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.498152 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.498152 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.498152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.498434 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:17.498573 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:17.498678 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 16:16:17.498801 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":76,"threads_started":1}
I20260809 16:16:17.502100 8328 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:17.502800 8328 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:17.512008 8328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: Generated new TSK 0
I20260809 16:16:17.512177 8328 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab.
Entry for principal oryx/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab.
I20260809 16:16:17.535931 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41929
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab
--principal=oryx/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:45003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:17.614944 8357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:17.615130 8357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:17.615152 8357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:17.616281 8357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:17.616318 8357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:17.616336 8357 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:16:17.616353 8357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:17.617799 8357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:45003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab
--principal=oryx/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:41929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:17.617990 8357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:17.618167 8357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:17.622643 8365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:17.622712 8366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:17.622742 8370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:17.623013 8357 server_base.cc:1034] running on GCE node
I20260809 16:16:17.623234 8357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:17.623441 8357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:17.624574 8357 hybrid_clock.cc:648] HybridClock initialized: now 1786292177624557 us; error 32 us; skew 500 ppm
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:17.627401 8357 init.cc:377] Logged in from keytab as oryx/127.27.217.1@KRBTEST.COM (short username oryx)
I20260809 16:16:17.627908 8357 webserver.cc:460] Webserver started at http://127.27.217.1:39425/ using document root <none> and password file <none>
I20260809 16:16:17.628159 8357 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:17.628217 8357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:17.628353 8357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:17.629710 8357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "76f45d2690ca4af5bcb39c3e5becbb1c"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "38e9f22a35e4d753587174c632500f0a"
server_key_iv: "333391a4f70a0c24e471dcf8c81fc2bf"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.630125 8357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "76f45d2690ca4af5bcb39c3e5becbb1c"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "38e9f22a35e4d753587174c632500f0a"
server_key_iv: "333391a4f70a0c24e471dcf8c81fc2bf"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.631784 8357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260809 16:16:17.636598 8380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:17.636754 8357 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260809 16:16:17.636821 8357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "76f45d2690ca4af5bcb39c3e5becbb1c"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "38e9f22a35e4d753587174c632500f0a"
server_key_iv: "333391a4f70a0c24e471dcf8c81fc2bf"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.636886 8357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:17.647966 8357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:17.649747 8357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:17.649852 8357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:17.650344 8357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:17.650393 8357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:17.650419 8357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:17.650437 8357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:17.656771 8357 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:40001
I20260809 16:16:17.656910 8562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:40001 every 8 connection(s)
I20260809 16:16:17.657140 8357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:17.659723 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.650717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:59617 (local address 127.27.217.62:41929)
0809 16:16:17.650781 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.650784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.650965 (+ 181us) server_negotiation.cc:407] Connection header received
0809 16:16:17.651436 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.651438 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.651449 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.651528 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.652326 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.653090 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.654501 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.654805 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.654891 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.657254 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:17.657256 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:17.657256 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:17.657264 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:17.658511 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.658860 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.658861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.658861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.658917 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.659124 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.659124 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.659125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.659233 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:17.659288 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:17.659531 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 16:16:17.659614 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:16:17.659863 8395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.650690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41929 (local address 127.27.217.1:59617)
0809 16:16:17.650842 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:17.650881 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:17.651351 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:17.651594 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:17.651598 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:17.651932 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:17.652196 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.652202 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.653182 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.653184 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.654400 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.654403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.654905 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.654906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.655052 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.655527 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:17.655538 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:17.657173 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:17.658584 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.658590 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.658592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.658795 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.658969 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.658970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.658970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.659070 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.659291 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:17.659298 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:17.659419 (+ 121us) client_negotiation.cc:769] Sending connection context
0809 16:16:17.659502 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 16:16:17.659646 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
I20260809 16:16:17.660305 8564 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41929
I20260809 16:16:17.660339 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 8357
I20260809 16:16:17.660382 8564 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:17.660442 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:17.660542 8564 heartbeater.cc:511] Master 127.27.217.62:41929 requested a full tablet report, sending...
I20260809 16:16:17.660638 28516 external_mini_cluster.cc:1428] Setting key 12c3d8001fcefd79725b5eec187a2520
I20260809 16:16:17.661055 8232 ts_manager.cc:194] Registered new tserver with Master: 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001)
I20260809 16:16:17.661855 8232 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:59617
I20260809 16:16:17.666760 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.662038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:43001 (local address 127.27.217.62:41929)
0809 16:16:17.662084 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.662086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.662093 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:16:17.662107 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.662108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.662115 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.662162 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.662481 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.662989 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.663630 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.663876 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.663930 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.664671 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:17.664673 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:17.664673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:17.664679 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:17.665825 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.666123 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.666124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.666124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.666175 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.666331 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.666332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.666332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.666428 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:17.666483 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:17.666612 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 16:16:17.666673 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:17.666774 8574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.661352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41929 (local address 127.27.217.1:43001)
0809 16:16:17.661465 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:17.661474 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:17.661518 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:17.662179 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:17.662180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:17.662349 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:17.662414 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.662416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.663071 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.663072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.663561 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.663563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.663938 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.663938 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.663995 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.664348 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:17.664351 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:17.664597 (+ 246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:17.665908 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.665909 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.665909 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.666065 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.666227 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.666228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.666228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.666283 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.666480 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:17.666481 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:17.666523 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 16:16:17.666582 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 16:16:17.666675 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":66,"threads_started":1}
WARNING: no policy specified for oryx/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab.
Entry for principal oryx/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab.
I20260809 16:16:17.685479 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41929
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab
--principal=oryx/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:45003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:17.765214 8580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:17.765417 8580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:17.765440 8580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:17.766556 8580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:17.766594 8580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:17.766613 8580 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:16:17.766645 8580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:17.768133 8580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:45003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab
--principal=oryx/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:41929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:17.768352 8580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:17.768561 8580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:17.773300 8588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:17.773303 8592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:17.773316 8590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:17.773547 8580 server_base.cc:1034] running on GCE node
I20260809 16:16:17.773739 8580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:17.773947 8580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:17.775092 8580 hybrid_clock.cc:648] HybridClock initialized: now 1786292177775079 us; error 27 us; skew 500 ppm
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:17.777514 8580 init.cc:377] Logged in from keytab as oryx/127.27.217.2@KRBTEST.COM (short username oryx)
I20260809 16:16:17.777917 8580 webserver.cc:460] Webserver started at http://127.27.217.2:34913/ using document root <none> and password file <none>
I20260809 16:16:17.778116 8580 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:17.778163 8580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:17.778285 8580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:17.779264 8580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "95c5286cc1db41e2be4eea04224f74e9"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "248dda0147d678e10903d91f9c5704b2"
server_key_iv: "4e4829e3267899c39b0d891a11fbd6a3"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.779580 8580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "95c5286cc1db41e2be4eea04224f74e9"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "248dda0147d678e10903d91f9c5704b2"
server_key_iv: "4e4829e3267899c39b0d891a11fbd6a3"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.780802 8580 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:17.781468 8603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:17.781620 8580 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:17.781703 8580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "95c5286cc1db41e2be4eea04224f74e9"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "248dda0147d678e10903d91f9c5704b2"
server_key_iv: "4e4829e3267899c39b0d891a11fbd6a3"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.781761 8580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:17.791917 8580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:17.793984 8580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:17.794111 8580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:17.794572 8580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:17.794616 8580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:17.794643 8580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:17.794670 8580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:17.801183 8580 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:34963
I20260809 16:16:17.801293 8783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:34963 every 8 connection(s)
I20260809 16:16:17.801532 8580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:16:17.803901 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.794933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:39761 (local address 127.27.217.62:41929)
0809 16:16:17.794994 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.794996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.795169 (+ 173us) server_negotiation.cc:407] Connection header received
0809 16:16:17.795616 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.795618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.795630 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.795742 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.796352 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.797105 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.798642 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.798939 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.799005 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.801457 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:17.801458 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:17.801458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:17.801466 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:17.802666 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.803018 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.803019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.803020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.803078 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.803295 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.803296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.803296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.803406 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:17.803460 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:17.803734 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 16:16:17.803811 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:16:17.804049 8623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.794920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41929 (local address 127.27.217.2:39761)
0809 16:16:17.795053 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:17.795090 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:17.795534 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:17.795804 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:17.795807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:17.796030 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:17.796266 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.796272 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.797205 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.797206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.798531 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.798536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.799045 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.799046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.799202 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.799649 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:17.799659 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:17.801375 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:17.802738 (+ 1363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.802744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.802745 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.802954 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.803131 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.803131 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.803132 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.803234 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.803461 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:17.803467 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:17.803591 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 16:16:17.803693 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 16:16:17.803852 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":70,"threads_started":1}
I20260809 16:16:17.804472 8784 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41929
I20260809 16:16:17.804543 8784 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:17.804693 8784 heartbeater.cc:511] Master 127.27.217.62:41929 requested a full tablet report, sending...
I20260809 16:16:17.805047 8234 ts_manager.cc:194] Registered new tserver with Master: 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963)
I20260809 16:16:17.805418 8234 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:39761
I20260809 16:16:17.810102 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.805474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:50935 (local address 127.27.217.62:41929)
0809 16:16:17.805579 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.805582 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.805607 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:16:17.805650 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.805651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.805660 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.805716 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.806035 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.806474 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.807116 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.807321 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.807387 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.808137 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:17.808138 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:17.808138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:17.808144 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:17.809206 (+ 1062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.809495 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.809496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.809496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.809547 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.809683 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.809683 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.809684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.809820 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:17.809873 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:17.809983 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 16:16:17.810044 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 16:16:17.810125 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.805394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41929 (local address 127.27.217.2:50935)
0809 16:16:17.805551 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:17.805561 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:17.805615 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:17.805723 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:17.805724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:17.805915 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:17.805973 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.805975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.806544 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.806545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.807024 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.807026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.807389 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.807389 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.807433 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.807806 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:17.807810 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:17.808066 (+ 256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:17.809268 (+ 1202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.809269 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.809269 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.809426 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.809595 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.809596 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.809596 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.809639 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.809872 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:17.809872 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:17.809904 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 16:16:17.809946 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 16:16:17.810029 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
I20260809 16:16:17.810158 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 8580
I20260809 16:16:17.810266 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:17.810446 28516 external_mini_cluster.cc:1428] Setting key 0ea7f02b6dfc52cb2329f335b67d2e98
WARNING: no policy specified for oryx/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab.
Entry for principal oryx/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab.
I20260809 16:16:17.833709 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41929
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab
--principal=oryx/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:45003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:17.914181 8798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:17.914434 8798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:17.914465 8798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:17.916100 8798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:17.916154 8798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:17.916181 8798 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 16:16:17.916267 8798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:17.917822 8798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:45003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab
--principal=oryx/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.217.62:41929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:17.918059 8798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:17.918278 8798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:17.922864 8814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:17.922948 8813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:17.923010 8798 server_base.cc:1034] running on GCE node
W20260809 16:16:17.923117 8817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:17.923295 8798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:17.923488 8798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:17.924644 8798 hybrid_clock.cc:648] HybridClock initialized: now 1786292177924616 us; error 42 us; skew 500 ppm
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:17.927055 8798 init.cc:377] Logged in from keytab as oryx/127.27.217.3@KRBTEST.COM (short username oryx)
I20260809 16:16:17.927448 8798 webserver.cc:460] Webserver started at http://127.27.217.3:35037/ using document root <none> and password file <none>
I20260809 16:16:17.927662 8798 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:17.927732 8798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:17.927834 8798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:17.928813 8798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "130509dbd157471d8ec433aa3e8f4bdf"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "e1676dd2eff6b67b6a390fb25bfb66df"
server_key_iv: "242de07d180221b97d6d892b59d9cd31"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.929103 8798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "130509dbd157471d8ec433aa3e8f4bdf"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "e1676dd2eff6b67b6a390fb25bfb66df"
server_key_iv: "242de07d180221b97d6d892b59d9cd31"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.930269 8798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:16:17.930915 8832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:17.931053 8798 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:17.931133 8798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "130509dbd157471d8ec433aa3e8f4bdf"
format_stamp: "Formatted at 2026-08-09 16:16:17 on dist-test-slave-nj21"
server_key: "e1676dd2eff6b67b6a390fb25bfb66df"
server_key_iv: "242de07d180221b97d6d892b59d9cd31"
server_key_version: "encryptionkey@0"
I20260809 16:16:17.931196 8798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:17.948550 8798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:17.950537 8798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:17.950667 8798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:17.951157 8798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:17.951193 8798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:17.951213 8798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:17.951224 8798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:17.957937 8798 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:46389
I20260809 16:16:17.958024 9021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:46389 every 8 connection(s)
I20260809 16:16:17.958273 8798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:17.960388 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.951589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:60565 (local address 127.27.217.62:41929)
0809 16:16:17.951634 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.951636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.951883 (+ 247us) server_negotiation.cc:407] Connection header received
0809 16:16:17.952376 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.952378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.952390 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.952443 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.953075 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.953560 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.954562 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.954806 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.954865 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.957844 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:17.957846 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:17.957846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:17.957854 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:17.959120 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.959472 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.959473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.959474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.959530 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.959768 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.959769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.959769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.959888 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:17.959946 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:17.960220 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 16:16:17.960297 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:17.960557 8849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.951580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41929 (local address 127.27.217.3:60565)
0809 16:16:17.951755 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:17.951789 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:17.952282 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:17.952509 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:17.952513 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:17.952804 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:17.952985 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.952990 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.953639 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.953640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.954482 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.954485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.954873 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.954874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.955008 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.955467 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:17.955485 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:17.957763 (+ 2278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:17.959192 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.959198 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.959200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.959409 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.959582 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.959583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.959583 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.959717 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.959943 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:17.959949 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:17.960096 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 16:16:17.960176 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 16:16:17.960348 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260809 16:16:17.960979 9022 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41929
I20260809 16:16:17.961054 9022 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:17.961239 9022 heartbeater.cc:511] Master 127.27.217.62:41929 requested a full tablet report, sending...
I20260809 16:16:17.961604 8232 ts_manager.cc:194] Registered new tserver with Master: 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389)
I20260809 16:16:17.962105 8232 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:60565
I20260809 16:16:17.966580 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.961998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:37677 (local address 127.27.217.62:41929)
0809 16:16:17.962037 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.962039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.962154 (+ 115us) server_negotiation.cc:407] Connection header received
0809 16:16:17.962245 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.962247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.962257 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.962313 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.962584 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.963083 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.963756 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.963956 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.964009 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.964690 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:17.964691 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:17.964691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:17.964697 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:17.965655 (+ 958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.965943 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.965943 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.965944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.965994 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.966147 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.966148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.966148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.966244 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:17.966297 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:17.966428 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 16:16:17.966492 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:16:17.966593 9033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.961946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41929 (local address 127.27.217.3:37677)
0809 16:16:17.962093 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:17.962102 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:17.962190 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:17.962316 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:17.962316 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:17.962464 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:17.962517 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.962518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.963160 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.963161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.963695 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:17.963697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.964012 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.964013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:17.964080 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.964379 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:17.964382 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:17.964618 (+ 236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:17.965726 (+ 1108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.965726 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.965727 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.965885 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.966045 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:17.966046 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:17.966046 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:17.966100 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:17.966295 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:17.966295 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:17.966338 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 16:16:17.966399 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 16:16:17.966496 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":62,"threads_started":1}
I20260809 16:16:17.968058 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 8798
I20260809 16:16:17.968175 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:17.968361 28516 external_mini_cluster.cc:1428] Setting key cb4d47f8c5dc9c514013259871d14cf5
I20260809 16:16:17.969069 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 16:16:17.989732 8318 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:17.984668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56786 (local address 127.27.217.62:41929)
0809 16:16:17.984719 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.984720 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.984729 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:17.984796 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.984797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.984807 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.984851 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.985430 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.985896 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.986583 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.986756 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.986808 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.989655 (+ 2847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56786: BlockingRecv error: recv got EOF from 127.0.0.1:56786 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 09 16:16:17 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:17.996407 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:17.990404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56788 (local address 127.27.217.62:41929)
0809 16:16:17.990477 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:17.990478 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:17.990487 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:17.990535 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:17.990536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:17.990544 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:17.990588 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:17.990949 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.991434 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.992105 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:17.992299 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:17.992345 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:17.994280 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:17.994282 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:17.994283 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:17.994289 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:17.995464 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.995750 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.995752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.995752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.995806 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:17.995962 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:17.995963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:17.995963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:17.996064 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:17.996146 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:17.996251 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 16:16:17.996321 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 16:16:17.997695 8232 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56788:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:17.999197 8232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:18.005015 9058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.001156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46389 (local address 127.0.0.1:57198)
0809 16:16:18.001311 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.001349 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.001406 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.001811 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.001811 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.001814 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.001883 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.001884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.002739 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.002740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.003879 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.003881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.004726 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.004727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.004805 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.004818 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.004891 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.004943 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":53,"threads_started":1}
I20260809 16:16:18.005035 9062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.001262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57198 (local address 127.27.217.3:46389)
0809 16:16:18.001645 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.001650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.001660 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:18.001697 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.001700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.001715 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.001959 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.002025 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.002663 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.003973 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.004650 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.004715 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.004795 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.004907 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.004945 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":77,"threads_started":1}
I20260809 16:16:18.005326 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.001156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40001 (local address 127.0.0.1:35156)
0809 16:16:18.001435 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.001443 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.001480 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.001781 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.001784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.001786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.001852 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.001854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.003138 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.003139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.004216 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.004218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.005094 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.005094 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.005157 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.005159 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.005185 (+ 26us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.005217 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":27,"spinlock_wait_cycles":768,"thread_start_us":49,"threads_started":1}
I20260809 16:16:18.005558 9065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.001445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42102 (local address 127.27.217.2:34963)
0809 16:16:18.001608 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.001613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.001681 (+ 68us) server_negotiation.cc:407] Connection header received
0809 16:16:18.001755 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.001757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.001770 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.001868 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.002043 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.003082 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.004084 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.004844 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.004912 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.004981 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.005422 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.005462 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
I20260809 16:16:18.005554 9070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.001447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35156 (local address 127.27.217.1:40001)
0809 16:16:18.001608 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.001613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.001623 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:18.001666 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.001668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.001683 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.001922 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.001984 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.003053 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.004308 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.005013 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.005281 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.005390 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.005417 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.005459 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260809 16:16:18.005237 9063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.001344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34963 (local address 127.0.0.1:42102)
0809 16:16:18.001621 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.001631 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.001693 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.001938 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.001938 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.001941 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.001973 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.001974 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.003160 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.003160 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.004014 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.004016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.005018 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.005019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.005079 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.005083 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.005125 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.005164 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":2,"thread_start_us":50,"threads_started":1}
I20260809 16:16:18.006177 8881 tablet_service.cc:1467] Processing CreateTablet for tablet 283de1cbcf2243d4839494f27bd5d6fe (DEFAULT_TABLE table=test-table [id=6c725b46e6a84fa58a2dc16aae3af772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.006182 8685 tablet_service.cc:1467] Processing CreateTablet for tablet 283de1cbcf2243d4839494f27bd5d6fe (DEFAULT_TABLE table=test-table [id=6c725b46e6a84fa58a2dc16aae3af772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.006187 8459 tablet_service.cc:1467] Processing CreateTablet for tablet 283de1cbcf2243d4839494f27bd5d6fe (DEFAULT_TABLE table=test-table [id=6c725b46e6a84fa58a2dc16aae3af772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.006511 8459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283de1cbcf2243d4839494f27bd5d6fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.006525 8881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283de1cbcf2243d4839494f27bd5d6fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.006525 8685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 283de1cbcf2243d4839494f27bd5d6fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.009665 9072 tablet_bootstrap.cc:492] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: Bootstrap starting.
I20260809 16:16:18.010226 9072 tablet_bootstrap.cc:654] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.010205 9076 tablet_bootstrap.cc:492] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: Bootstrap starting.
I20260809 16:16:18.010456 9073 tablet_bootstrap.cc:492] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Bootstrap starting.
I20260809 16:16:18.010557 9072 log.cc:824] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:18.011025 9073 tablet_bootstrap.cc:654] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.011300 9072 tablet_bootstrap.cc:492] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: No bootstrap required, opened a new log
I20260809 16:16:18.011350 9073 log.cc:824] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:18.011371 9072 ts_tablet_manager.cc:1397] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:18.011998 9073 tablet_bootstrap.cc:492] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: No bootstrap required, opened a new log
I20260809 16:16:18.012058 9073 ts_tablet_manager.cc:1397] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:18.012136 9076 tablet_bootstrap.cc:654] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.012488 9076 log.cc:824] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:18.013231 9076 tablet_bootstrap.cc:492] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: No bootstrap required, opened a new log
I20260809 16:16:18.013314 9076 ts_tablet_manager.cc:1397] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 16:16:18.013573 9072 raft_consensus.cc:348] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.013737 9072 raft_consensus.cc:374] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.013659 9073 raft_consensus.cc:348] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.013772 9072 raft_consensus.cc:729] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f45d2690ca4af5bcb39c3e5becbb1c, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.013793 9073 raft_consensus.cc:374] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.013825 9073 raft_consensus.cc:729] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c5286cc1db41e2be4eea04224f74e9, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.013911 9072 consensus_queue.cc:260] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.013953 9073 consensus_queue.cc:260] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.014168 9072 ts_tablet_manager.cc:1428] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:16:18.014209 9073 ts_tablet_manager.cc:1428] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:18.014231 8784 heartbeater.cc:503] Master 127.27.217.62:41929 was elected leader, sending a full tablet report...
I20260809 16:16:18.014288 8564 heartbeater.cc:503] Master 127.27.217.62:41929 was elected leader, sending a full tablet report...
I20260809 16:16:18.015235 9076 raft_consensus.cc:348] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.015355 9076 raft_consensus.cc:374] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.015375 9076 raft_consensus.cc:729] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130509dbd157471d8ec433aa3e8f4bdf, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.015461 9076 consensus_queue.cc:260] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.015666 9076 ts_tablet_manager.cc:1428] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:18.015762 9022 heartbeater.cc:503] Master 127.27.217.62:41929 was elected leader, sending a full tablet report...
W20260809 16:16:18.052152 8786 tablet.cc:2369] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:18.084961 9084 raft_consensus.cc:482] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:18.085100 9084 raft_consensus.cc:504] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.085453 9084 leader_election.cc:288] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001), 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963)
I20260809 16:16:18.088176 8849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.085683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40001 (local address 127.27.217.3:55803)
0809 16:16:18.085740 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.085753 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.085809 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.085946 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.085947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.085948 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.086019 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.086020 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.086632 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.086633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.087384 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.087386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.087927 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.087927 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.088012 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.088015 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.088059 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.088104 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 16:16:18.088176 9070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.085758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:55803 (local address 127.27.217.1:40001)
0809 16:16:18.085819 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.085821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.085833 (+ 12us) server_negotiation.cc:407] Connection header received
0809 16:16:18.085872 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.085873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.085883 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.085934 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.086078 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.086558 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.087472 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.087857 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.087917 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.087926 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.088070 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.088105 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:16:18.088337 9085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.085798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34963 (local address 127.27.217.3:53087)
0809 16:16:18.085997 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.086005 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.086064 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.086185 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.086186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.086188 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.086262 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.086264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.086850 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.086851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.087553 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.087554 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.088083 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.088084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.088158 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.088162 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.088205 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.088243 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":120,"threads_started":1}
I20260809 16:16:18.088321 9065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.085902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:53087 (local address 127.27.217.2:34963)
0809 16:16:18.085944 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.085946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.086065 (+ 119us) server_negotiation.cc:407] Connection header received
0809 16:16:18.086118 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.086119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.086128 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.086174 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.086322 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.086770 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.087640 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.088013 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.088075 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.088083 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.088215 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.088249 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:16:18.088608 8494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "283de1cbcf2243d4839494f27bd5d6fe" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" is_pre_election: true
I20260809 16:16:18.088757 8494 raft_consensus.cc:2454] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 0.
I20260809 16:16:18.088903 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "283de1cbcf2243d4839494f27bd5d6fe" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c5286cc1db41e2be4eea04224f74e9" is_pre_election: true
I20260809 16:16:18.088968 8839 leader_election.cc:302] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130509dbd157471d8ec433aa3e8f4bdf, 76f45d2690ca4af5bcb39c3e5becbb1c; no voters:
I20260809 16:16:18.089030 8718 raft_consensus.cc:2454] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 0.
I20260809 16:16:18.089107 9084 raft_consensus.cc:2781] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:18.089216 9084 raft_consensus.cc:482] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:18.089247 9084 raft_consensus.cc:3037] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.090148 9084 raft_consensus.cc:504] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.090332 9084 leader_election.cc:288] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 election: Requested vote from peers 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001), 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963)
I20260809 16:16:18.090404 8494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "283de1cbcf2243d4839494f27bd5d6fe" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c"
I20260809 16:16:18.090480 8494 raft_consensus.cc:3037] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.091223 8494 raft_consensus.cc:2454] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 1.
I20260809 16:16:18.091405 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "283de1cbcf2243d4839494f27bd5d6fe" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c5286cc1db41e2be4eea04224f74e9"
I20260809 16:16:18.091444 8839 leader_election.cc:302] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130509dbd157471d8ec433aa3e8f4bdf, 76f45d2690ca4af5bcb39c3e5becbb1c; no voters:
I20260809 16:16:18.091518 9084 raft_consensus.cc:2781] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:18.091490 8718 raft_consensus.cc:3037] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.091710 9084 raft_consensus.cc:686] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 1 LEADER]: Becoming Leader. State: Replica: 130509dbd157471d8ec433aa3e8f4bdf, State: Running, Role: LEADER
I20260809 16:16:18.091806 9084 consensus_queue.cc:237] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } }
I20260809 16:16:18.092357 8718 raft_consensus.cc:2454] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 1.
I20260809 16:16:18.092625 8234 catalog_manager.cc:5495] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf reported cstate change: term changed from 0 to 1, leader changed from <none> to 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3). New cstate: current_term: 1 leader_uuid: "130509dbd157471d8ec433aa3e8f4bdf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } health_report { overall_health: UNKNOWN } } }
I20260809 16:16:18.118445 9062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.116373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57200 (local address 127.27.217.3:46389)
0809 16:16:18.116429 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.116431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.116441 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:18.116485 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.116485 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.116503 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.116568 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:18.116679 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.117152 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.117844 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.118031 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.118086 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.118189 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.118291 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.118352 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.118366 (+ 14us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.118384 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 16:16:18.120270 8494 raft_consensus.cc:1261] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Refusing update from remote peer 130509dbd157471d8ec433aa3e8f4bdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.120271 8718 raft_consensus.cc:1261] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Refusing update from remote peer 130509dbd157471d8ec433aa3e8f4bdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.120599 9084 consensus_queue.cc:1035] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.120755 9087 consensus_queue.cc:1035] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.123840 9093 mvcc.cc:205] Tried to move back new op lower bound from 7316652761577861120 to 7316652761464659968. Current Snapshot: MvccSnapshot[applied={T|T < 7316652761577861120}]
I20260809 16:16:18.125088 8232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:18.125191 8232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:18.125944 8232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: Sending DeleteTablet for 3 replicas of tablet 283de1cbcf2243d4839494f27bd5d6fe
I20260809 16:16:18.126274 8685 tablet_service.cc:1514] Processing DeleteTablet for tablet 283de1cbcf2243d4839494f27bd5d6fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:42102
I20260809 16:16:18.126262 8881 tablet_service.cc:1514] Processing DeleteTablet for tablet 283de1cbcf2243d4839494f27bd5d6fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:57198
I20260809 16:16:18.126268 8459 tablet_service.cc:1514] Processing DeleteTablet for tablet 283de1cbcf2243d4839494f27bd5d6fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:35156
I20260809 16:16:18.126540 9107 tablet_replica.cc:330] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: stopping tablet replica
I20260809 16:16:18.126634 9107 raft_consensus.cc:2229] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:18.126765 9110 tablet_replica.cc:330] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: stopping tablet replica
I20260809 16:16:18.126806 8232 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56788:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:18.126963 8232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:18.127002 9107 raft_consensus.cc:2258] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.126894 9110 raft_consensus.cc:2229] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:18.127635 9110 raft_consensus.cc:2258] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.128192 9110 ts_tablet_manager.cc:1905] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.128227 8459 tablet_service.cc:1467] Processing CreateTablet for tablet 30693da4833a403cbd3247607bb19568 (DEFAULT_TABLE table=test-table [id=a92550cf4d8d4c7e93e6a4fee4622ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.128252 8881 tablet_service.cc:1467] Processing CreateTablet for tablet 30693da4833a403cbd3247607bb19568 (DEFAULT_TABLE table=test-table [id=a92550cf4d8d4c7e93e6a4fee4622ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.128362 8881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30693da4833a403cbd3247607bb19568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.128374 8459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30693da4833a403cbd3247607bb19568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.129796 9110 ts_tablet_manager.cc:1918] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:18.129834 8685 tablet_service.cc:1467] Processing CreateTablet for tablet 30693da4833a403cbd3247607bb19568 (DEFAULT_TABLE table=test-table [id=a92550cf4d8d4c7e93e6a4fee4622ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.129957 8685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30693da4833a403cbd3247607bb19568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.129954 9110 log.cc:1196] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/283de1cbcf2243d4839494f27bd5d6fe
I20260809 16:16:18.130259 9110 ts_tablet_manager.cc:1939] T 283de1cbcf2243d4839494f27bd5d6fe P 130509dbd157471d8ec433aa3e8f4bdf: Deleting consensus metadata
I20260809 16:16:18.130278 9072 tablet_bootstrap.cc:492] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: Bootstrap starting.
I20260809 16:16:18.130700 9108 tablet_replica.cc:330] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: stopping tablet replica
I20260809 16:16:18.130856 9108 raft_consensus.cc:2229] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:18.130720 9072 tablet_bootstrap.cc:654] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.131017 9108 raft_consensus.cc:2258] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.131314 9073 tablet_bootstrap.cc:492] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: Bootstrap starting.
I20260809 16:16:18.131326 9076 tablet_bootstrap.cc:492] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: Bootstrap starting.
I20260809 16:16:18.131759 9073 tablet_bootstrap.cc:654] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.131759 9076 tablet_bootstrap.cc:654] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.132360 8200 catalog_manager.cc:4841] TS 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389): tablet 283de1cbcf2243d4839494f27bd5d6fe (table test-table [id=6c725b46e6a84fa58a2dc16aae3af772]) successfully deleted
I20260809 16:16:18.132400 9107 ts_tablet_manager.cc:1905] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.132490 9073 tablet_bootstrap.cc:492] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: No bootstrap required, opened a new log
I20260809 16:16:18.132536 9073 ts_tablet_manager.cc:1397] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:18.132702 9073 raft_consensus.cc:348] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.132772 9073 raft_consensus.cc:374] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.132790 9073 raft_consensus.cc:729] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c5286cc1db41e2be4eea04224f74e9, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.132829 9073 consensus_queue.cc:260] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.132910 9073 ts_tablet_manager.cc:1428] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:18.133330 9108 ts_tablet_manager.cc:1905] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.133811 9107 ts_tablet_manager.cc:1918] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:18.133939 9107 log.cc:1196] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/283de1cbcf2243d4839494f27bd5d6fe
I20260809 16:16:18.134212 9107 ts_tablet_manager.cc:1939] T 283de1cbcf2243d4839494f27bd5d6fe P 95c5286cc1db41e2be4eea04224f74e9: Deleting consensus metadata
I20260809 16:16:18.134657 8205 catalog_manager.cc:4841] TS 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963): tablet 283de1cbcf2243d4839494f27bd5d6fe (table test-table [id=6c725b46e6a84fa58a2dc16aae3af772]) successfully deleted
I20260809 16:16:18.134776 9108 ts_tablet_manager.cc:1918] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:18.134830 9108 log.cc:1196] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/283de1cbcf2243d4839494f27bd5d6fe
I20260809 16:16:18.134917 9072 tablet_bootstrap.cc:492] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: No bootstrap required, opened a new log
I20260809 16:16:18.134963 9072 ts_tablet_manager.cc:1397] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 16:16:18.134992 9108 ts_tablet_manager.cc:1939] T 283de1cbcf2243d4839494f27bd5d6fe P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting consensus metadata
I20260809 16:16:18.135113 9072 raft_consensus.cc:348] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.135182 9072 raft_consensus.cc:374] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.135217 9072 raft_consensus.cc:729] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f45d2690ca4af5bcb39c3e5becbb1c, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.135250 9072 consensus_queue.cc:260] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.135329 8205 catalog_manager.cc:4841] TS 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001): tablet 283de1cbcf2243d4839494f27bd5d6fe (table test-table [id=6c725b46e6a84fa58a2dc16aae3af772]) successfully deleted
I20260809 16:16:18.135349 9072 ts_tablet_manager.cc:1428] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:18.135401 9076 tablet_bootstrap.cc:492] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: No bootstrap required, opened a new log
I20260809 16:16:18.135439 9076 ts_tablet_manager.cc:1397] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260809 16:16:18.135587 9076 raft_consensus.cc:348] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.135658 9076 raft_consensus.cc:374] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.135700 9076 raft_consensus.cc:729] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130509dbd157471d8ec433aa3e8f4bdf, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.135738 9076 consensus_queue.cc:260] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.135839 9076 ts_tablet_manager.cc:1428] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260809 16:16:18.157780 8566 tablet.cc:2369] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:16:18.208771 9023 tablet.cc:2369] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:18.251909 9087 raft_consensus.cc:482] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:18.252000 9087 raft_consensus.cc:504] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.252120 9087 leader_election.cc:288] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001), 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963)
I20260809 16:16:18.252369 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30693da4833a403cbd3247607bb19568" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c5286cc1db41e2be4eea04224f74e9" is_pre_election: true
I20260809 16:16:18.252367 8494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30693da4833a403cbd3247607bb19568" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" is_pre_election: true
I20260809 16:16:18.252467 8494 raft_consensus.cc:2454] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 0.
I20260809 16:16:18.252465 8718 raft_consensus.cc:2454] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 0.
I20260809 16:16:18.252601 8839 leader_election.cc:302] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130509dbd157471d8ec433aa3e8f4bdf, 95c5286cc1db41e2be4eea04224f74e9; no voters:
I20260809 16:16:18.252708 9087 raft_consensus.cc:2781] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:18.252763 9087 raft_consensus.cc:482] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:18.252779 9087 raft_consensus.cc:3037] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.253471 9087 raft_consensus.cc:504] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.253577 9087 leader_election.cc:288] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 election: Requested vote from peers 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001), 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963)
I20260809 16:16:18.253762 8494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30693da4833a403cbd3247607bb19568" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c"
I20260809 16:16:18.253831 8494 raft_consensus.cc:3037] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.253800 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30693da4833a403cbd3247607bb19568" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c5286cc1db41e2be4eea04224f74e9"
I20260809 16:16:18.253886 8718 raft_consensus.cc:3037] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.254444 8494 raft_consensus.cc:2454] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 1.
I20260809 16:16:18.254547 8718 raft_consensus.cc:2454] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 1.
I20260809 16:16:18.254606 8839 leader_election.cc:302] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130509dbd157471d8ec433aa3e8f4bdf, 76f45d2690ca4af5bcb39c3e5becbb1c; no voters:
I20260809 16:16:18.254703 9087 raft_consensus.cc:2781] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:18.254752 9087 raft_consensus.cc:686] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 LEADER]: Becoming Leader. State: Replica: 130509dbd157471d8ec433aa3e8f4bdf, State: Running, Role: LEADER
I20260809 16:16:18.254802 9087 consensus_queue.cc:237] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.255414 8228 catalog_manager.cc:5495] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf reported cstate change: term changed from 0 to 1, leader changed from <none> to 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3). New cstate: current_term: 1 leader_uuid: "130509dbd157471d8ec433aa3e8f4bdf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } health_report { overall_health: HEALTHY } } }
Aug 09 16:16:18 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292177, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.62@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:18.298849 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.292526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56804 (local address 127.27.217.62:41929)
0809 16:16:18.292576 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.292578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.292679 (+ 101us) server_negotiation.cc:407] Connection header received
0809 16:16:18.292783 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.292784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.292793 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.292840 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:18.293340 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.293829 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.294488 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.294661 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.294713 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.296669 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:18.296670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:18.296671 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:18.296678 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:18.297833 (+ 1155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:18.298158 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:18.298159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:18.298159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:18.298208 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:18.298363 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:18.298364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:18.298364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:18.298472 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:18.298529 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.298664 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.298750 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:16:18.298933 9126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.292476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41929 (local address 127.0.0.1:56804)
0809 16:16:18.292612 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.292622 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.292691 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.292850 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.292851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.293211 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:18.293270 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.293272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.293894 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.293894 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.294422 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.294424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.294716 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.294716 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.294764 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.295210 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:18.295214 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:18.296583 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:18.297905 (+ 1322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:18.297913 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:18.297915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:18.298095 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:18.298261 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:18.298262 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:18.298262 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:18.298314 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:18.298526 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:18.298534 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:18.298580 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.298637 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.298818 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":80,"thread_start_us":78,"threads_started":1}
I20260809 16:16:18.300697 8228 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:56804:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 16:16:18.300899 8228 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:18.302225 8881 tablet_service.cc:1467] Processing CreateTablet for tablet d61e91cf6aea445790d8db8705881ff7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e4fc325a67642e0a61872376945d9b0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:16:18.302242 8685 tablet_service.cc:1467] Processing CreateTablet for tablet d61e91cf6aea445790d8db8705881ff7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e4fc325a67642e0a61872376945d9b0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:16:18.302240 8459 tablet_service.cc:1467] Processing CreateTablet for tablet d61e91cf6aea445790d8db8705881ff7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e4fc325a67642e0a61872376945d9b0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 16:16:18.302394 8459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61e91cf6aea445790d8db8705881ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.302397 8685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61e91cf6aea445790d8db8705881ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.302392 8881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61e91cf6aea445790d8db8705881ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.303607 9076 tablet_bootstrap.cc:492] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: Bootstrap starting.
I20260809 16:16:18.303896 9073 tablet_bootstrap.cc:492] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: Bootstrap starting.
I20260809 16:16:18.303982 9072 tablet_bootstrap.cc:492] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: Bootstrap starting.
I20260809 16:16:18.304056 9076 tablet_bootstrap.cc:654] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.304366 9072 tablet_bootstrap.cc:654] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.304369 9073 tablet_bootstrap.cc:654] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.304726 9076 tablet_bootstrap.cc:492] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: No bootstrap required, opened a new log
I20260809 16:16:18.304781 9076 ts_tablet_manager.cc:1397] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:18.304905 9076 raft_consensus.cc:348] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.304977 9076 raft_consensus.cc:374] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.304977 9072 tablet_bootstrap.cc:492] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: No bootstrap required, opened a new log
I20260809 16:16:18.304998 9076 raft_consensus.cc:729] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130509dbd157471d8ec433aa3e8f4bdf, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.305015 9072 ts_tablet_manager.cc:1397] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:18.305045 9076 consensus_queue.cc:260] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.305142 9076 ts_tablet_manager.cc:1428] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:18.305152 9073 tablet_bootstrap.cc:492] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: No bootstrap required, opened a new log
I20260809 16:16:18.305148 9072 raft_consensus.cc:348] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.305197 9073 ts_tablet_manager.cc:1397] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:18.305205 9072 raft_consensus.cc:374] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.305235 9072 raft_consensus.cc:729] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f45d2690ca4af5bcb39c3e5becbb1c, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.305270 9072 consensus_queue.cc:260] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.305246 9087 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.305342 9087 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:16:18.305348 9072 ts_tablet_manager.cc:1428] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:18.305336 9073 raft_consensus.cc:348] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.305393 9073 raft_consensus.cc:374] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.305413 9073 raft_consensus.cc:729] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c5286cc1db41e2be4eea04224f74e9, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.305451 9073 consensus_queue.cc:260] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.305526 9073 ts_tablet_manager.cc:1428] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:18.305652 9082 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.305730 9082 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:16:18.305872 9083 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.305954 9083 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:16:18.355083 9083 raft_consensus.cc:482] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:18.355189 9083 raft_consensus.cc:504] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.355505 9083 leader_election.cc:288] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001), 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389)
I20260809 16:16:18.358321 9062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.355785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:35637 (local address 127.27.217.3:46389)
0809 16:16:18.355839 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.355841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.355946 (+ 105us) server_negotiation.cc:407] Connection header received
0809 16:16:18.355993 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.355994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.356006 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.356053 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.356199 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.356665 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.357640 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.358013 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.358076 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.358085 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.358213 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.358252 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:16:18.358318 9070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.355749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:43335 (local address 127.27.217.1:40001)
0809 16:16:18.355824 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.355825 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.355932 (+ 107us) server_negotiation.cc:407] Connection header received
0809 16:16:18.355983 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.355984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.355993 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.356044 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.356198 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.356664 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.357628 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.358000 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.358059 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.358067 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.358215 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.358249 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:16:18.358369 9140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.355713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46389 (local address 127.27.217.2:35637)
0809 16:16:18.355871 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.355880 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.355941 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.356065 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.356065 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.356088 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.356139 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.356140 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.356733 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.356734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.357553 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.357555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.358085 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.358086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.358147 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.358152 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.358196 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.358241 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":1,"thread_start_us":60,"threads_started":1}
I20260809 16:16:18.358378 9141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.355657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40001 (local address 127.27.217.2:43335)
0809 16:16:18.355860 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.355870 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.355930 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.356059 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.356059 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.356061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.356134 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.356137 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.356739 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.356741 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.357537 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.357539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.358076 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.358077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.358146 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.358150 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.358200 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.358253 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":33,"thread_start_us":94,"threads_started":1}
I20260809 16:16:18.358629 8948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61e91cf6aea445790d8db8705881ff7" candidate_uuid: "95c5286cc1db41e2be4eea04224f74e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130509dbd157471d8ec433aa3e8f4bdf" is_pre_election: true
I20260809 16:16:18.358691 8494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61e91cf6aea445790d8db8705881ff7" candidate_uuid: "95c5286cc1db41e2be4eea04224f74e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" is_pre_election: true
I20260809 16:16:18.358776 8948 raft_consensus.cc:2454] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95c5286cc1db41e2be4eea04224f74e9 in term 0.
I20260809 16:16:18.358775 8494 raft_consensus.cc:2454] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95c5286cc1db41e2be4eea04224f74e9 in term 0.
I20260809 16:16:18.358945 8610 leader_election.cc:302] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f45d2690ca4af5bcb39c3e5becbb1c, 95c5286cc1db41e2be4eea04224f74e9; no voters:
I20260809 16:16:18.359079 9083 raft_consensus.cc:2781] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:18.359125 9083 raft_consensus.cc:482] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:18.359139 9083 raft_consensus.cc:3037] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.359843 9083 raft_consensus.cc:504] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.359985 9083 leader_election.cc:288] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [CANDIDATE]: Term 1 election: Requested vote from peers 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001), 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389)
I20260809 16:16:18.360128 8494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61e91cf6aea445790d8db8705881ff7" candidate_uuid: "95c5286cc1db41e2be4eea04224f74e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c"
I20260809 16:16:18.360261 8494 raft_consensus.cc:3037] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.360242 8948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61e91cf6aea445790d8db8705881ff7" candidate_uuid: "95c5286cc1db41e2be4eea04224f74e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130509dbd157471d8ec433aa3e8f4bdf"
I20260809 16:16:18.360328 8948 raft_consensus.cc:3037] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.360970 8948 raft_consensus.cc:2454] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95c5286cc1db41e2be4eea04224f74e9 in term 1.
I20260809 16:16:18.360994 8494 raft_consensus.cc:2454] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95c5286cc1db41e2be4eea04224f74e9 in term 1.
I20260809 16:16:18.361156 8605 leader_election.cc:302] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130509dbd157471d8ec433aa3e8f4bdf, 95c5286cc1db41e2be4eea04224f74e9; no voters:
I20260809 16:16:18.361263 9083 raft_consensus.cc:2781] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:18.361403 9083 raft_consensus.cc:686] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 LEADER]: Becoming Leader. State: Replica: 95c5286cc1db41e2be4eea04224f74e9, State: Running, Role: LEADER
I20260809 16:16:18.361469 9083 consensus_queue.cc:237] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.361776 9142 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: TxnStatusTablet state changed. Reason: New leader 95c5286cc1db41e2be4eea04224f74e9. Latest consensus state: current_term: 1 leader_uuid: "95c5286cc1db41e2be4eea04224f74e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.361869 9142 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:16:18.362056 9145 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 16:16:18.362205 9145 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 16:16:18.362164 8232 catalog_manager.cc:5495] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2). New cstate: current_term: 1 leader_uuid: "95c5286cc1db41e2be4eea04224f74e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } health_report { overall_health: UNKNOWN } } }
I20260809 16:16:18.379699 9065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.377360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42114 (local address 127.27.217.2:34963)
0809 16:16:18.377415 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.377417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.377425 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:18.377511 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.377512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.377529 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.377587 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:18.377730 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.378225 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.378938 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.379130 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.379183 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.379374 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.379475 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.379535 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.379582 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.379604 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:16:18.379720 9126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.377302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34963 (local address 127.0.0.1:42114)
0809 16:16:18.377385 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.377396 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.377443 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.377596 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.377597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.377598 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:16:18.377673 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.377676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.378304 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.378305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.378866 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.378868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.379189 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.379190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.379271 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.379294 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.379529 (+ 235us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.379537 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.379580 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.379630 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 16:16:18.380995 8948 raft_consensus.cc:1261] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Refusing update from remote peer 95c5286cc1db41e2be4eea04224f74e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.381003 8494 raft_consensus.cc:1261] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Refusing update from remote peer 95c5286cc1db41e2be4eea04224f74e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.381294 9142 consensus_queue.cc:1035] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.381454 9083 consensus_queue.cc:1035] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.382078 9087 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: TxnStatusTablet state changed. Reason: New leader 95c5286cc1db41e2be4eea04224f74e9. Latest consensus state: current_term: 1 leader_uuid: "95c5286cc1db41e2be4eea04224f74e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.382076 9082 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: TxnStatusTablet state changed. Reason: New leader 95c5286cc1db41e2be4eea04224f74e9. Latest consensus state: current_term: 1 leader_uuid: "95c5286cc1db41e2be4eea04224f74e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.382171 9087 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:16:18.382171 9082 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:16:18.382936 9083 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95c5286cc1db41e2be4eea04224f74e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.383023 9083 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:16:18.383080 9092 mvcc.cc:205] Tried to move back new op lower bound from 7316652762646286336 to 7316652762569179136. Current Snapshot: MvccSnapshot[applied={T|T < 7316652762646286336 or (T in {7316652762646286336})}]
I20260809 16:16:18.383430 9091 mvcc.cc:205] Tried to move back new op lower bound from 7316652762646286336 to 7316652762569179136. Current Snapshot: MvccSnapshot[applied={T|T < 7316652762646286336}]
I20260809 16:16:18.383574 9087 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95c5286cc1db41e2be4eea04224f74e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.383646 9087 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 130509dbd157471d8ec433aa3e8f4bdf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:16:18.383596 9142 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95c5286cc1db41e2be4eea04224f74e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.383754 9142 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 95c5286cc1db41e2be4eea04224f74e9: This TxnStatusTablet replica's current role is: LEADER
I20260809 16:16:18.384490 9082 tablet_replica.cc:439] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95c5286cc1db41e2be4eea04224f74e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } } }
I20260809 16:16:18.384584 9082 tablet_replica.cc:442] T d61e91cf6aea445790d8db8705881ff7 P 76f45d2690ca4af5bcb39c3e5becbb1c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 16:16:18.389824 9065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.387291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:52289 (local address 127.27.217.2:34963)
0809 16:16:18.387325 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.387327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.387360 (+ 33us) server_negotiation.cc:407] Connection header received
0809 16:16:18.387435 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.387436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.387443 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.387482 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:18.387616 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.388101 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.389158 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.389380 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.389425 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.389618 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.389645 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.389682 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.389752 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.389768 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 16:16:18.389881 9033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.387231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34963 (local address 127.27.217.3:52289)
0809 16:16:18.387315 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.387326 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.387376 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.387503 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.387504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.387506 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:16:18.387558 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.387560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.388170 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.388171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.389062 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.389064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.389440 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.389441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.389514 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.389533 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.389687 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.389688 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.389752 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.389801 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 16:16:18.392339 8718 raft_consensus.cc:1261] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Refusing update from remote peer 130509dbd157471d8ec433aa3e8f4bdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.392527 8494 raft_consensus.cc:1261] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Refusing update from remote peer 130509dbd157471d8ec433aa3e8f4bdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.392570 9084 consensus_queue.cc:1035] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.392701 9084 consensus_queue.cc:1035] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.401297 9062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.398556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:50201 (local address 127.27.217.3:46389)
0809 16:16:18.398608 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.398610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.398775 (+ 165us) server_negotiation.cc:407] Connection header received
0809 16:16:18.398840 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.398841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.398850 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.398892 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:18.399028 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.399513 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.400605 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.400810 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.400862 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.401076 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.401110 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.401153 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.401214 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.401234 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 16:16:18.401347 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.398537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46389 (local address 127.27.217.2:50201)
0809 16:16:18.398714 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.398725 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.398789 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.398907 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.398907 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.398909 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:16:18.398974 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.398976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.399583 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.399584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.400523 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.400525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.400902 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.400903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.400967 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.400982 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.401157 (+ 175us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.401160 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.401209 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.401251 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":103,"threads_started":1}
I20260809 16:16:18.408133 8232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:18.408231 8232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56788:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:18.408802 8232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: Sending DeleteTablet for 3 replicas of tablet 30693da4833a403cbd3247607bb19568
I20260809 16:16:18.409060 8459 tablet_service.cc:1514] Processing DeleteTablet for tablet 30693da4833a403cbd3247607bb19568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:35156
I20260809 16:16:18.409067 8881 tablet_service.cc:1514] Processing DeleteTablet for tablet 30693da4833a403cbd3247607bb19568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:57198
I20260809 16:16:18.409116 8685 tablet_service.cc:1514] Processing DeleteTablet for tablet 30693da4833a403cbd3247607bb19568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:42102
I20260809 16:16:18.409163 9108 tablet_replica.cc:330] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: stopping tablet replica
I20260809 16:16:18.409211 9107 tablet_replica.cc:330] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: stopping tablet replica
I20260809 16:16:18.409240 9108 raft_consensus.cc:2229] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:18.409267 9107 raft_consensus.cc:2229] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:18.409281 9108 raft_consensus.cc:2258] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.409298 9107 raft_consensus.cc:2258] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.409363 9110 tablet_replica.cc:330] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: stopping tablet replica
I20260809 16:16:18.409422 9110 raft_consensus.cc:2229] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:18.409497 9110 raft_consensus.cc:2258] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.409644 9107 ts_tablet_manager.cc:1905] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.409657 9108 ts_tablet_manager.cc:1905] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.409827 9110 ts_tablet_manager.cc:1905] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.411336 9107 ts_tablet_manager.cc:1918] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:16:18.411370 9110 ts_tablet_manager.cc:1918] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:16:18.411396 9107 log.cc:1196] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/30693da4833a403cbd3247607bb19568
I20260809 16:16:18.411412 9110 log.cc:1196] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/30693da4833a403cbd3247607bb19568
I20260809 16:16:18.411569 9108 ts_tablet_manager.cc:1918] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:16:18.411605 9110 ts_tablet_manager.cc:1939] T 30693da4833a403cbd3247607bb19568 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting consensus metadata
I20260809 16:16:18.411605 9107 ts_tablet_manager.cc:1939] T 30693da4833a403cbd3247607bb19568 P 95c5286cc1db41e2be4eea04224f74e9: Deleting consensus metadata
I20260809 16:16:18.411633 9108 log.cc:1196] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/30693da4833a403cbd3247607bb19568
I20260809 16:16:18.411955 9108 ts_tablet_manager.cc:1939] T 30693da4833a403cbd3247607bb19568 P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting consensus metadata
I20260809 16:16:18.412065 8200 catalog_manager.cc:4841] TS 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389): tablet 30693da4833a403cbd3247607bb19568 (table test-table [id=a92550cf4d8d4c7e93e6a4fee4622ea7]) successfully deleted
I20260809 16:16:18.412235 8205 catalog_manager.cc:4841] TS 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001): tablet 30693da4833a403cbd3247607bb19568 (table test-table [id=a92550cf4d8d4c7e93e6a4fee4622ea7]) successfully deleted
I20260809 16:16:18.412303 8205 catalog_manager.cc:4841] TS 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963): tablet 30693da4833a403cbd3247607bb19568 (table test-table [id=a92550cf4d8d4c7e93e6a4fee4622ea7]) successfully deleted
Aug 09 16:16:18 dist-test-slave-nj21 krb5kdc[8155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 16:16:18 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:18 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 16:16:18.441051 8318 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:18.435143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56806 (local address 127.27.217.62:41929)
0809 16:16:18.435198 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.435200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.435298 (+ 98us) server_negotiation.cc:407] Connection header received
0809 16:16:18.435370 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.435371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.435379 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.435425 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:18.436196 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.436687 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.437766 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.437947 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.437989 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.440989 (+ 3000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56806: BlockingRecv error: recv got EOF from 127.0.0.1:56806 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 09 16:16:18 dist-test-slave-nj21 krb5kdc[8155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM
I20260809 16:16:18.448593 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.441864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56814 (local address 127.27.217.62:41929)
0809 16:16:18.441901 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.441903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.441940 (+ 37us) server_negotiation.cc:407] Connection header received
0809 16:16:18.442007 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.442008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.442015 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.442055 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:18.442577 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.443021 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.443996 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.444163 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.444205 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.446411 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:18.446412 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:18.446412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:18.446418 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:18.447577 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:18.447963 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:18.447964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:18.447964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:18.448011 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:18.448193 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:18.448193 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:18.448193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:18.448290 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:18.448356 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.448485 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.448536 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:16:18.450042 8232 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:18.450232 8232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:18.451597 8881 tablet_service.cc:1467] Processing CreateTablet for tablet 785225e03b734d6680ab03960bcc2b02 (DEFAULT_TABLE table=test-table [id=9e4e64ad45f042bbbf9c547d24532f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.451655 8685 tablet_service.cc:1467] Processing CreateTablet for tablet 785225e03b734d6680ab03960bcc2b02 (DEFAULT_TABLE table=test-table [id=9e4e64ad45f042bbbf9c547d24532f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.451768 8881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 785225e03b734d6680ab03960bcc2b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.451810 8685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 785225e03b734d6680ab03960bcc2b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.451815 8459 tablet_service.cc:1467] Processing CreateTablet for tablet 785225e03b734d6680ab03960bcc2b02 (DEFAULT_TABLE table=test-table [id=9e4e64ad45f042bbbf9c547d24532f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.451949 8459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 785225e03b734d6680ab03960bcc2b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.453079 9076 tablet_bootstrap.cc:492] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: Bootstrap starting.
I20260809 16:16:18.453080 9073 tablet_bootstrap.cc:492] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: Bootstrap starting.
I20260809 16:16:18.453399 9072 tablet_bootstrap.cc:492] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: Bootstrap starting.
I20260809 16:16:18.453436 9076 tablet_bootstrap.cc:654] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.453465 9073 tablet_bootstrap.cc:654] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.453811 9072 tablet_bootstrap.cc:654] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.454073 9073 tablet_bootstrap.cc:492] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: No bootstrap required, opened a new log
I20260809 16:16:18.454125 9073 ts_tablet_manager.cc:1397] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:18.454275 9073 raft_consensus.cc:348] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.454365 9073 raft_consensus.cc:374] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.454391 9073 raft_consensus.cc:729] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c5286cc1db41e2be4eea04224f74e9, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.454427 9073 consensus_queue.cc:260] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.454479 9072 tablet_bootstrap.cc:492] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: No bootstrap required, opened a new log
I20260809 16:16:18.454505 9073 ts_tablet_manager.cc:1428] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:18.454532 9072 ts_tablet_manager.cc:1397] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:18.454694 9072 raft_consensus.cc:348] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.454769 9072 raft_consensus.cc:374] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.454789 9072 raft_consensus.cc:729] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f45d2690ca4af5bcb39c3e5becbb1c, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.454773 9076 tablet_bootstrap.cc:492] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: No bootstrap required, opened a new log
I20260809 16:16:18.454828 9076 ts_tablet_manager.cc:1397] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260809 16:16:18.454826 9072 consensus_queue.cc:260] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.454908 9072 ts_tablet_manager.cc:1428] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:18.454931 9076 raft_consensus.cc:348] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.454991 9076 raft_consensus.cc:374] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.455009 9076 raft_consensus.cc:729] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130509dbd157471d8ec433aa3e8f4bdf, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.455050 9076 consensus_queue.cc:260] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.455129 9076 ts_tablet_manager.cc:1428] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:18.493297 9164 raft_consensus.cc:482] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:18.493389 9164 raft_consensus.cc:504] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.493554 9164 leader_election.cc:288] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001), 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963)
I20260809 16:16:18.493758 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "785225e03b734d6680ab03960bcc2b02" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c5286cc1db41e2be4eea04224f74e9" is_pre_election: true
I20260809 16:16:18.493741 8494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "785225e03b734d6680ab03960bcc2b02" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" is_pre_election: true
I20260809 16:16:18.493844 8718 raft_consensus.cc:2454] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 0.
I20260809 16:16:18.493849 8494 raft_consensus.cc:2454] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 0.
I20260809 16:16:18.493993 8839 leader_election.cc:302] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130509dbd157471d8ec433aa3e8f4bdf, 76f45d2690ca4af5bcb39c3e5becbb1c; no voters:
I20260809 16:16:18.494120 9164 raft_consensus.cc:2781] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:18.494148 9164 raft_consensus.cc:482] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:18.494168 9164 raft_consensus.cc:3037] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.494858 9164 raft_consensus.cc:504] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.494966 9164 leader_election.cc:288] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 election: Requested vote from peers 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001), 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963)
I20260809 16:16:18.495147 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "785225e03b734d6680ab03960bcc2b02" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c5286cc1db41e2be4eea04224f74e9"
I20260809 16:16:18.495148 8494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "785225e03b734d6680ab03960bcc2b02" candidate_uuid: "130509dbd157471d8ec433aa3e8f4bdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c"
I20260809 16:16:18.495223 8494 raft_consensus.cc:3037] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.495223 8718 raft_consensus.cc:3037] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.495961 8718 raft_consensus.cc:2454] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 1.
I20260809 16:16:18.495961 8494 raft_consensus.cc:2454] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130509dbd157471d8ec433aa3e8f4bdf in term 1.
I20260809 16:16:18.496131 8839 leader_election.cc:302] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130509dbd157471d8ec433aa3e8f4bdf, 95c5286cc1db41e2be4eea04224f74e9; no voters:
I20260809 16:16:18.496222 9164 raft_consensus.cc:2781] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:18.496279 9164 raft_consensus.cc:686] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 LEADER]: Becoming Leader. State: Replica: 130509dbd157471d8ec433aa3e8f4bdf, State: Running, Role: LEADER
I20260809 16:16:18.496331 9164 consensus_queue.cc:237] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.496838 8232 catalog_manager.cc:5495] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf reported cstate change: term changed from 0 to 1, leader changed from <none> to 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3). New cstate: current_term: 1 leader_uuid: "130509dbd157471d8ec433aa3e8f4bdf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } health_report { overall_health: HEALTHY } } }
I20260809 16:16:18.503458 9062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.501041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57204 (local address 127.27.217.3:46389)
0809 16:16:18.501085 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.501087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.501148 (+ 61us) server_negotiation.cc:407] Connection header received
0809 16:16:18.501216 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.501217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.501227 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.501267 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:18.501406 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.501856 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.502908 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.503076 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.503115 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.503276 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.503305 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.503335 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.503388 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.503405 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:16:18.504216 8494 raft_consensus.cc:1261] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Refusing update from remote peer 130509dbd157471d8ec433aa3e8f4bdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.504256 8718 raft_consensus.cc:1261] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Refusing update from remote peer 130509dbd157471d8ec433aa3e8f4bdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.504426 9087 consensus_queue.cc:1035] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.504531 9164 consensus_queue.cc:1035] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.506693 8234 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:18.506789 8234 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:18.507366 8234 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: Sending DeleteTablet for 3 replicas of tablet 785225e03b734d6680ab03960bcc2b02
I20260809 16:16:18.507591 8881 tablet_service.cc:1514] Processing DeleteTablet for tablet 785225e03b734d6680ab03960bcc2b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:57198
I20260809 16:16:18.507597 8459 tablet_service.cc:1514] Processing DeleteTablet for tablet 785225e03b734d6680ab03960bcc2b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:35156
I20260809 16:16:18.507689 9110 tablet_replica.cc:330] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: stopping tablet replica
I20260809 16:16:18.507696 9108 tablet_replica.cc:330] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: stopping tablet replica
I20260809 16:16:18.507658 8685 tablet_service.cc:1514] Processing DeleteTablet for tablet 785225e03b734d6680ab03960bcc2b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:42102
I20260809 16:16:18.507737 9110 raft_consensus.cc:2229] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:18.507738 9108 raft_consensus.cc:2229] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:18.507754 9107 tablet_replica.cc:330] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: stopping tablet replica
I20260809 16:16:18.507781 9108 raft_consensus.cc:2258] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.507793 9107 raft_consensus.cc:2229] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:18.507803 9110 raft_consensus.cc:2258] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.507826 9107 raft_consensus.cc:2258] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.508160 9110 ts_tablet_manager.cc:1905] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.508170 8234 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:18.508318 8234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:18.509436 8459 tablet_service.cc:1467] Processing CreateTablet for tablet 7e334af796574487840633fd88de5b70 (DEFAULT_TABLE table=test-table [id=72d2d8be524c4bc5907bebab73caf3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.509509 8685 tablet_service.cc:1467] Processing CreateTablet for tablet 7e334af796574487840633fd88de5b70 (DEFAULT_TABLE table=test-table [id=72d2d8be524c4bc5907bebab73caf3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.509567 8459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e334af796574487840633fd88de5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.509641 8685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e334af796574487840633fd88de5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.509737 9110 ts_tablet_manager.cc:1918] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:18.509789 9110 log.cc:1196] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/785225e03b734d6680ab03960bcc2b02
I20260809 16:16:18.509966 9110 ts_tablet_manager.cc:1939] T 785225e03b734d6680ab03960bcc2b02 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting consensus metadata
I20260809 16:16:18.510098 8881 tablet_service.cc:1467] Processing CreateTablet for tablet 7e334af796574487840633fd88de5b70 (DEFAULT_TABLE table=test-table [id=72d2d8be524c4bc5907bebab73caf3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:18.510175 8881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e334af796574487840633fd88de5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:18.510874 9073 tablet_bootstrap.cc:492] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: Bootstrap starting.
I20260809 16:16:18.511071 9072 tablet_bootstrap.cc:492] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c: Bootstrap starting.
I20260809 16:16:18.511144 9073 tablet_bootstrap.cc:654] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.511392 9076 tablet_bootstrap.cc:492] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: Bootstrap starting.
I20260809 16:16:18.511736 9076 tablet_bootstrap.cc:654] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.511993 9108 ts_tablet_manager.cc:1905] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.512217 9076 tablet_bootstrap.cc:492] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: No bootstrap required, opened a new log
I20260809 16:16:18.512252 9076 ts_tablet_manager.cc:1397] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:18.512341 9076 raft_consensus.cc:348] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.512394 9076 raft_consensus.cc:374] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.512410 9076 raft_consensus.cc:729] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130509dbd157471d8ec433aa3e8f4bdf, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.512445 9076 consensus_queue.cc:260] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.512518 9076 ts_tablet_manager.cc:1428] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:18.512607 8200 catalog_manager.cc:4841] TS 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389): tablet 785225e03b734d6680ab03960bcc2b02 (table test-table [id=9e4e64ad45f042bbbf9c547d24532f44]) successfully deleted
I20260809 16:16:18.513064 9072 tablet_bootstrap.cc:654] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:18.513342 9108 ts_tablet_manager.cc:1918] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:18.513397 9108 log.cc:1196] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/785225e03b734d6680ab03960bcc2b02
I20260809 16:16:18.513458 9073 tablet_bootstrap.cc:492] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: No bootstrap required, opened a new log
I20260809 16:16:18.513500 9073 ts_tablet_manager.cc:1397] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 16:16:18.513533 9107 ts_tablet_manager.cc:1905] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.513582 9108 ts_tablet_manager.cc:1939] T 785225e03b734d6680ab03960bcc2b02 P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting consensus metadata
I20260809 16:16:18.513594 9073 raft_consensus.cc:348] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.513655 9073 raft_consensus.cc:374] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.513674 9073 raft_consensus.cc:729] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c5286cc1db41e2be4eea04224f74e9, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.513718 9073 consensus_queue.cc:260] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.513814 9073 ts_tablet_manager.cc:1428] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:18.513849 8205 catalog_manager.cc:4841] TS 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001): tablet 785225e03b734d6680ab03960bcc2b02 (table test-table [id=9e4e64ad45f042bbbf9c547d24532f44]) successfully deleted
I20260809 16:16:18.514267 9072 tablet_bootstrap.cc:492] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c: No bootstrap required, opened a new log
I20260809 16:16:18.514320 9072 ts_tablet_manager.cc:1397] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 16:16:18.514454 9072 raft_consensus.cc:348] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.514519 9072 raft_consensus.cc:374] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:18.514541 9072 raft_consensus.cc:729] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f45d2690ca4af5bcb39c3e5becbb1c, State: Initialized, Role: FOLLOWER
I20260809 16:16:18.514585 9072 consensus_queue.cc:260] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.514670 9072 ts_tablet_manager.cc:1428] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:18.514873 9107 ts_tablet_manager.cc:1918] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:18.514926 9107 log.cc:1196] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/785225e03b734d6680ab03960bcc2b02
I20260809 16:16:18.515120 9107 ts_tablet_manager.cc:1939] T 785225e03b734d6680ab03960bcc2b02 P 95c5286cc1db41e2be4eea04224f74e9: Deleting consensus metadata
I20260809 16:16:18.515384 8205 catalog_manager.cc:4841] TS 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963): tablet 785225e03b734d6680ab03960bcc2b02 (table test-table [id=9e4e64ad45f042bbbf9c547d24532f44]) successfully deleted
I20260809 16:16:18.792644 9082 raft_consensus.cc:482] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:18.792763 9082 raft_consensus.cc:504] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.793123 9082 leader_election.cc:288] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963), 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389)
I20260809 16:16:18.796123 9065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.793394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:46839 (local address 127.27.217.2:34963)
0809 16:16:18.793448 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.793450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.793572 (+ 122us) server_negotiation.cc:407] Connection header received
0809 16:16:18.793615 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.793616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.793627 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.793673 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.793825 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.794439 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.795411 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.795834 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.795891 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.795901 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.796018 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.796052 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:16:18.796139 9198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.793319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34963 (local address 127.27.217.1:46839)
0809 16:16:18.793492 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.793502 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.793565 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.793682 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.793682 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.793684 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.793742 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.793744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.794526 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.794527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.795326 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.795328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.795910 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.795911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.795961 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.795965 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.796006 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.796049 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":68,"threads_started":1}
I20260809 16:16:18.796181 9062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.793413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:40713 (local address 127.27.217.3:46389)
0809 16:16:18.793466 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.793468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.793573 (+ 105us) server_negotiation.cc:407] Connection header received
0809 16:16:18.793658 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.793659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.793668 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.793710 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:18.793861 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.794572 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.795473 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.795867 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.795926 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.795935 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.796081 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.796117 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 16:16:18.796402 9201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.793343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46389 (local address 127.27.217.1:40713)
0809 16:16:18.793502 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.793511 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.793583 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.793722 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.793723 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.793725 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:18.793801 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.793803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.794647 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.794648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.795386 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.795388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.795960 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.795961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.796019 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.796022 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.796067 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.796105 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
I20260809 16:16:18.796450 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e334af796574487840633fd88de5b70" candidate_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c5286cc1db41e2be4eea04224f74e9" is_pre_election: true
I20260809 16:16:18.796543 8718 raft_consensus.cc:2454] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f45d2690ca4af5bcb39c3e5becbb1c in term 0.
I20260809 16:16:18.796701 8948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e334af796574487840633fd88de5b70" candidate_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130509dbd157471d8ec433aa3e8f4bdf" is_pre_election: true
I20260809 16:16:18.796794 8948 raft_consensus.cc:2454] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f45d2690ca4af5bcb39c3e5becbb1c in term 0.
I20260809 16:16:18.796794 8386 leader_election.cc:302] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f45d2690ca4af5bcb39c3e5becbb1c, 95c5286cc1db41e2be4eea04224f74e9; no voters:
I20260809 16:16:18.796926 9082 raft_consensus.cc:2781] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:18.796967 9082 raft_consensus.cc:482] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:18.796984 9082 raft_consensus.cc:3037] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.797690 9082 raft_consensus.cc:504] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.797814 9082 leader_election.cc:288] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [CANDIDATE]: Term 1 election: Requested vote from peers 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963), 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389)
I20260809 16:16:18.797969 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e334af796574487840633fd88de5b70" candidate_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c5286cc1db41e2be4eea04224f74e9"
I20260809 16:16:18.797993 8948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e334af796574487840633fd88de5b70" candidate_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130509dbd157471d8ec433aa3e8f4bdf"
I20260809 16:16:18.798043 8718 raft_consensus.cc:3037] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.798066 8948 raft_consensus.cc:3037] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:18.798625 8718 raft_consensus.cc:2454] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f45d2690ca4af5bcb39c3e5becbb1c in term 1.
I20260809 16:16:18.798781 8386 leader_election.cc:302] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f45d2690ca4af5bcb39c3e5becbb1c, 95c5286cc1db41e2be4eea04224f74e9; no voters:
I20260809 16:16:18.798794 8948 raft_consensus.cc:2454] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f45d2690ca4af5bcb39c3e5becbb1c in term 1.
I20260809 16:16:18.798866 9082 raft_consensus.cc:2781] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:18.799023 9082 raft_consensus.cc:686] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 LEADER]: Becoming Leader. State: Replica: 76f45d2690ca4af5bcb39c3e5becbb1c, State: Running, Role: LEADER
I20260809 16:16:18.799094 9082 consensus_queue.cc:237] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } }
I20260809 16:16:18.799805 8234 catalog_manager.cc:5495] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1). New cstate: current_term: 1 leader_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f45d2690ca4af5bcb39c3e5becbb1c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 40001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 } health_report { overall_health: UNKNOWN } } }
I20260809 16:16:18.869900 9204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.867719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35170 (local address 127.27.217.1:40001)
0809 16:16:18.867829 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.867831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.867839 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:18.867874 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.867875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.867896 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.867969 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:18.868052 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.868550 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.869225 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.869415 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.869482 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.869574 (+ 92us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.869679 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.869764 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.869803 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.869821 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":67,"threads_started":1}
I20260809 16:16:18.874516 9065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.872327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:43899 (local address 127.27.217.2:34963)
0809 16:16:18.872384 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.872386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.872475 (+ 89us) server_negotiation.cc:407] Connection header received
0809 16:16:18.872529 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.872530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.872544 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.872585 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:18.872713 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.873177 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.873915 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.874097 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.874149 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.874306 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.874334 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.874372 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.874422 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.874444 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 16:16:18.874544 9212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.872230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34963 (local address 127.27.217.1:43899)
0809 16:16:18.872413 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.872424 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.872482 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.872592 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.872593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.872594 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:16:18.872660 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.872661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.873246 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.873247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.873841 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.873843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.874155 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.874156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.874216 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.874233 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.874379 (+ 146us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.874380 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.874421 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.874462 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":86,"threads_started":1}
I20260809 16:16:18.877128 8718 raft_consensus.cc:1261] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Refusing update from remote peer 76f45d2690ca4af5bcb39c3e5becbb1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.877141 8948 raft_consensus.cc:1261] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Refusing update from remote peer 76f45d2690ca4af5bcb39c3e5becbb1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:18.877388 9082 consensus_queue.cc:1035] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "130509dbd157471d8ec433aa3e8f4bdf" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.877758 9202 consensus_queue.cc:1035] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c5286cc1db41e2be4eea04224f74e9" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:18.884315 9204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.882299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:39693 (local address 127.27.217.1:40001)
0809 16:16:18.882333 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:18.882334 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:18.882350 (+ 16us) server_negotiation.cc:407] Connection header received
0809 16:16:18.882391 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:18.882392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:18.882403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:18.882459 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:18.882556 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.883006 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.883705 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.883908 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.883964 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.884088 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.884127 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.884176 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:18.884229 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 16:16:18.884251 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:16:18.884338 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.882250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40001 (local address 127.27.217.2:39693)
0809 16:16:18.882294 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.882305 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:18.882341 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:18.882468 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:18.882469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:18.882471 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 16:16:18.882512 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.882514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.883070 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.883071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.883609 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:18.883611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:18.883962 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:18.883963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:18.884020 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:18.884027 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 16:16:18.884178 (+ 151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 16:16:18.884180 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:16:18.884225 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 16:16:18.884268 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260809 16:16:18.890887 8232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:18.890980 8232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:18.891584 8232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd1a0d0dd7b242088e3f806bedfc1553: Sending DeleteTablet for 3 replicas of tablet 7e334af796574487840633fd88de5b70
I20260809 16:16:18.891815 8459 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e334af796574487840633fd88de5b70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:35156
I20260809 16:16:18.891908 8685 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e334af796574487840633fd88de5b70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:42102
I20260809 16:16:18.891934 9108 tablet_replica.cc:330] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c: stopping tablet replica
I20260809 16:16:18.891997 9108 raft_consensus.cc:2229] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:18.891990 9107 tablet_replica.cc:330] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: stopping tablet replica
I20260809 16:16:18.892058 9107 raft_consensus.cc:2229] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:18.892089 9107 raft_consensus.cc:2258] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.892091 9108 raft_consensus.cc:2258] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.892161 8881 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e334af796574487840633fd88de5b70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:18 UTC) from {username='oryx', principal='oryx/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:57198
I20260809 16:16:18.892275 9110 tablet_replica.cc:330] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: stopping tablet replica
I20260809 16:16:18.892346 9110 raft_consensus.cc:2229] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:18.892379 9110 raft_consensus.cc:2258] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:18.892560 9108 ts_tablet_manager.cc:1905] T 7e334af796574487840633fd88de5b70 P 76f45d2690ca4af5bcb39c3e5becbb1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.892773 9107 ts_tablet_manager.cc:1905] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.892809 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 8357
I20260809 16:16:18.894443 9107 ts_tablet_manager.cc:1918] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:16:18.894500 9107 log.cc:1196] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/7e334af796574487840633fd88de5b70
I20260809 16:16:18.894733 9107 ts_tablet_manager.cc:1939] T 7e334af796574487840633fd88de5b70 P 95c5286cc1db41e2be4eea04224f74e9: Deleting consensus metadata
I20260809 16:16:18.895062 8205 catalog_manager.cc:4841] TS 95c5286cc1db41e2be4eea04224f74e9 (127.27.217.2:34963): tablet 7e334af796574487840633fd88de5b70 (table test-table [id=72d2d8be524c4bc5907bebab73caf3db]) successfully deleted
I20260809 16:16:18.895795 9110 ts_tablet_manager.cc:1905] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:18.897281 9110 ts_tablet_manager.cc:1918] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 16:16:18.897336 9110 log.cc:1196] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/7e334af796574487840633fd88de5b70
I20260809 16:16:18.897569 9110 ts_tablet_manager.cc:1939] T 7e334af796574487840633fd88de5b70 P 130509dbd157471d8ec433aa3e8f4bdf: Deleting consensus metadata
I20260809 16:16:18.897951 8200 catalog_manager.cc:4841] TS 130509dbd157471d8ec433aa3e8f4bdf (127.27.217.3:46389): tablet 7e334af796574487840633fd88de5b70 (table test-table [id=72d2d8be524c4bc5907bebab73caf3db]) successfully deleted
W20260809 16:16:18.904963 8205 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:40001 (error 108)
I20260809 16:16:18.905262 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 8580
I20260809 16:16:18.909363 9223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:18.905290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:40001 (local address 127.0.0.1:35178)
0809 16:16:18.909251 (+ 3961us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:18.909318 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:40001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3942,"thread_start_us":48,"threads_started":1}
W20260809 16:16:18.911094 8205 catalog_manager.cc:4584] TS 76f45d2690ca4af5bcb39c3e5becbb1c (127.27.217.1:40001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7e334af796574487840633fd88de5b70: Network error: Client connection negotiation failed: client connection to 127.27.217.1:40001: connect: Connection refused (error 111)
I20260809 16:16:18.915498 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 8798
I20260809 16:16:18.928076 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 8173
2026-08-09T16:16:18Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2831 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:18 dist-test-slave-nj21 krb5kdc[9230](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:18 dist-test-slave-nj21 krb5kdc[9230](info): set up 2 sockets
Aug 09 16:16:18 dist-test-slave-nj21 krb5kdc[9230](info): commencing operation
krb5kdc: starting...
W20260809 16:16:20.066737 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:20 dist-test-slave-nj21 krb5kdc[9230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:16:20.179804 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:37337
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:37337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:20.259300 9253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:20.259490 9253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:20.259521 9253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:20.260669 9253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:20.260711 9253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:20.260731 9253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:20.260746 9253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:20.260761 9253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:20.262176 9253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:37337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:37337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:20.262408 9253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:20.262602 9253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:20.267089 9263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:20.267087 9264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:20.267114 9266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:20.267261 9253 server_base.cc:1034] running on GCE node
I20260809 16:16:20.267560 9253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:20.267853 9253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:20.268987 9253 hybrid_clock.cc:648] HybridClock initialized: now 1786292180268977 us; error 40 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T16:16:20Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1346 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:20 dist-test-slave-nj21 krb5kdc[9275](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:20 dist-test-slave-nj21 krb5kdc[9275](info): set up 2 sockets
Aug 09 16:16:20 dist-test-slave-nj21 krb5kdc[9275](info): commencing operation
krb5kdc: starting...
W20260809 16:16:21.425050 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:21 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:16:21.535187 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:42329
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:42329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:21.613690 9297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:21.613880 9297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:21.613900 9297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:21.614955 9297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:21.614987 9297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:21.615000 9297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:21.615010 9297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:21.615020 9297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:21.616451 9297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:42329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:42329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:21.616638 9297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:21.616814 9297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:21.621258 9308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:21.621270 9311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:21.621431 9297 server_base.cc:1034] running on GCE node
W20260809 16:16:21.621289 9305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:21.621666 9297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:21.621903 9297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:21.623052 9297 hybrid_clock.cc:648] HybridClock initialized: now 1786292181623035 us; error 27 us; skew 500 ppm
Aug 09 16:16:21 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:21.629432 9297 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:16:21.629885 9297 webserver.cc:460] Webserver started at http://127.27.217.62:44883/ using document root <none> and password file <none>
I20260809 16:16:21.630110 9297 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:21.630157 9297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:21.630285 9297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:21.631258 9297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "465b354d5c3242f78de27ef9e70cd46d"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "78fb712e181b86ff7f035871639f5b04"
server_key_iv: "492e444087522a1f0e248743931a0140"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.631575 9297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "465b354d5c3242f78de27ef9e70cd46d"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "78fb712e181b86ff7f035871639f5b04"
server_key_iv: "492e444087522a1f0e248743931a0140"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.632803 9297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:21.633430 9319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:21.633571 9297 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:21.633652 9297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "465b354d5c3242f78de27ef9e70cd46d"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "78fb712e181b86ff7f035871639f5b04"
server_key_iv: "492e444087522a1f0e248743931a0140"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.633709 9297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:21.651721 9297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:21.653741 9297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:21.653885 9297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:21.657656 9297 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:42329
I20260809 16:16:21.657694 9404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:42329 every 8 connection(s)
I20260809 16:16:21.658027 9297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:21.658814 9406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:21.659415 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 9297
I20260809 16:16:21.659513 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:21.659698 28516 external_mini_cluster.cc:1428] Setting key 52d15b043231acd55529725b49b5712e
I20260809 16:16:21.661633 9406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Bootstrap starting.
I20260809 16:16:21.662326 9406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:21.662617 9406 log.cc:824] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:21.663271 9406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: No bootstrap required, opened a new log
I20260809 16:16:21.665320 9406 raft_consensus.cc:348] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } }
I20260809 16:16:21.665450 9406 raft_consensus.cc:374] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:21.665473 9406 raft_consensus.cc:729] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 465b354d5c3242f78de27ef9e70cd46d, State: Initialized, Role: FOLLOWER
I20260809 16:16:21.665578 9406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } }
I20260809 16:16:21.665650 9406 raft_consensus.cc:388] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:21.665680 9406 raft_consensus.cc:482] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:21.665726 9406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 0 FOLLOWER]: Advancing to term 1
Aug 09 16:16:21 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:21.666239 9406 raft_consensus.cc:504] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } }
I20260809 16:16:21.666332 9406 leader_election.cc:302] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 465b354d5c3242f78de27ef9e70cd46d; no voters:
I20260809 16:16:21.666486 9406 leader_election.cc:288] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:21.666531 9411 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:21.666725 9406 sys_catalog.cc:564] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:21.666750 9411 raft_consensus.cc:686] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 1 LEADER]: Becoming Leader. State: Replica: 465b354d5c3242f78de27ef9e70cd46d, State: Running, Role: LEADER
I20260809 16:16:21.667128 9411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } }
I20260809 16:16:21.667944 9413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "465b354d5c3242f78de27ef9e70cd46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } } }
I20260809 16:16:21.668191 9413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:21.668069 9414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 465b354d5c3242f78de27ef9e70cd46d. Latest consensus state: current_term: 1 leader_uuid: "465b354d5c3242f78de27ef9e70cd46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } } }
I20260809 16:16:21.668476 9414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: This master's current role is: LEADER
W20260809 16:16:21.668493 9431 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:16:21.668536 9431 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:16:21.668758 9434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:21.668955 9434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:21.670125 9409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:21.660172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33192 (local address 127.27.217.62:42329)
0809 16:16:21.660364 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:21.660374 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:21.660411 (+ 37us) server_negotiation.cc:407] Connection header received
0809 16:16:21.660916 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:21.660925 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:21.660989 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:21.661132 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:21.661678 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.662967 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.663741 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.664347 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.664467 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:21.666592 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:21.666596 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:21.666596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:21.666609 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:21.668526 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:21.668920 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:21.668924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:21.668924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:21.669024 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:21.669239 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:21.669240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:21.669240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:21.669553 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:21.669701 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:21.669798 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 16:16:21.669927 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260809 16:16:21.670447 9434 catalog_manager.cc:1347] Generated new cluster ID: 445707f483db4b8a926f357995e62c9f
I20260809 16:16:21.670493 9434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:21.688712 9434 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:21.689218 9434 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:21.697144 9434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Generated new TSK 0
I20260809 16:16:21.697304 9434 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:16:21.729838 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42329
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:21.808624 9446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:21.808822 9446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:21.808843 9446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:21.809932 9446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:21.809967 9446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:21.809991 9446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:21.811333 9446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:21.811513 9446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:21.811726 9446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:21.816270 9456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:21.816277 9451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:21.816323 9458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:21.816454 9446 server_base.cc:1034] running on GCE node
I20260809 16:16:21.816680 9446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:21.816908 9446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:21.818041 9446 hybrid_clock.cc:648] HybridClock initialized: now 1786292181818024 us; error 34 us; skew 500 ppm
Aug 09 16:16:21 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:21.820470 9446 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:16:21.820876 9446 webserver.cc:460] Webserver started at http://127.27.217.1:39439/ using document root <none> and password file <none>
I20260809 16:16:21.821069 9446 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:21.821111 9446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:21.821254 9446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:21.822240 9446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "a38093c15c8b4d92b1a3b15ba723dd14"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "22daf5a62a41d8b5b586a27238b497d6"
server_key_iv: "4c43cac210aff54a24dccb5ffc3bd1f6"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.822557 9446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "a38093c15c8b4d92b1a3b15ba723dd14"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "22daf5a62a41d8b5b586a27238b497d6"
server_key_iv: "4c43cac210aff54a24dccb5ffc3bd1f6"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.823786 9446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:16:21.824465 9467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:21.824604 9446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:21.824680 9446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "a38093c15c8b4d92b1a3b15ba723dd14"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "22daf5a62a41d8b5b586a27238b497d6"
server_key_iv: "4c43cac210aff54a24dccb5ffc3bd1f6"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.824746 9446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:21.838637 9446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:21.840587 9446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:21.840713 9446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:21.840914 9446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:21.841188 9446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:21.841230 9446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:21.841250 9446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:21.841274 9446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:21.846755 9446 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:37841
I20260809 16:16:21.846793 9679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:37841 every 8 connection(s)
I20260809 16:16:21.847074 9446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
Aug 09 16:16:21 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:21.854209 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 9446
I20260809 16:16:21.854306 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:21.854496 28516 external_mini_cluster.cc:1428] Setting key 08f0df8c006bf29f9fac8858129ebdfc
I20260809 16:16:21.855257 9409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:21.847731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:46355 (local address 127.27.217.62:42329)
0809 16:16:21.847773 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:21.847775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:21.847957 (+ 182us) server_negotiation.cc:407] Connection header received
0809 16:16:21.848396 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:21.848397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:21.848407 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:21.848453 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:21.849328 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.849834 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.850733 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.850928 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.850967 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:21.852843 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:21.852844 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:21.852844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:21.852855 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:21.853886 (+ 1031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:21.854228 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:21.854230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:21.854230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:21.854287 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:21.854593 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:21.854594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:21.854595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:21.854705 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:21.854771 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:21.855107 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 16:16:21.855193 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:16:21.855393 9683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:21.847706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:46355)
0809 16:16:21.847842 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:21.847874 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:21.848321 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:21.848511 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:21.848514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:21.849070 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:21.849260 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:21.849265 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.849903 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.849903 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:21.850669 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:21.850671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.850978 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.850978 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:21.851078 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:21.851496 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:21.851504 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:21.852774 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:21.853948 (+ 1174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:21.853953 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:21.853955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:21.854150 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:21.854368 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:21.854369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:21.854370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:21.854516 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:21.854776 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:21.854782 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:21.854929 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 16:16:21.855036 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 16:16:21.855165 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":73,"threads_started":1}
I20260809 16:16:21.855901 9681 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42329
I20260809 16:16:21.855989 9681 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:21.856148 9681 heartbeater.cc:511] Master 127.27.217.62:42329 requested a full tablet report, sending...
I20260809 16:16:21.856668 9342 ts_manager.cc:194] Registered new tserver with Master: a38093c15c8b4d92b1a3b15ba723dd14 (127.27.217.1:37841)
I20260809 16:16:21.857349 9342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:46355
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:16:21.878291 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42329
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:21.958299 9688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:21.958485 9688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:21.958515 9688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:21.959628 9688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:21.959702 9688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:21.959759 9688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:21.961176 9688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:21.961403 9688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:21.961598 9688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:21.966234 9702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:21.966234 9708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:21.966267 9703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:21.966399 9688 server_base.cc:1034] running on GCE node
I20260809 16:16:21.966670 9688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:21.966921 9688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:21.968065 9688 hybrid_clock.cc:648] HybridClock initialized: now 1786292181968050 us; error 29 us; skew 500 ppm
Aug 09 16:16:21 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:21.970492 9688 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:16:21.970846 9688 webserver.cc:460] Webserver started at http://127.27.217.2:33709/ using document root <none> and password file <none>
I20260809 16:16:21.971030 9688 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:21.971067 9688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:21.971154 9688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:21.972114 9688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "043c3d4554ce4daeb876763eb9e342a7"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "0694d4091652e04b97b2e6f3a3504922"
server_key_iv: "3d0053f71f6d03fa16a72b7b65686661"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.972404 9688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "043c3d4554ce4daeb876763eb9e342a7"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "0694d4091652e04b97b2e6f3a3504922"
server_key_iv: "3d0053f71f6d03fa16a72b7b65686661"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.973513 9688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:21.974085 9719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:21.974233 9688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:21.974311 9688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "043c3d4554ce4daeb876763eb9e342a7"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "0694d4091652e04b97b2e6f3a3504922"
server_key_iv: "3d0053f71f6d03fa16a72b7b65686661"
server_key_version: "encryptionkey@0"
I20260809 16:16:21.974372 9688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:21.984177 9688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:21.985730 9688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:21.985831 9688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:21.985991 9688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:21.986219 9688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:21.986248 9688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:21.986267 9688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:21.986284 9688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:21.991595 9688 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:40559
I20260809 16:16:21.991659 9895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:40559 every 8 connection(s)
I20260809 16:16:21.991930 9688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:16:21.992465 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 9688
I20260809 16:16:21.992586 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:21.992797 28516 external_mini_cluster.cc:1428] Setting key 2cbefe233c78ca61bd98ccd9897a6308
Aug 09 16:16:21 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:22.001029 9409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:21.992596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:54417 (local address 127.27.217.62:42329)
0809 16:16:21.992641 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:21.992644 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:21.992914 (+ 270us) server_negotiation.cc:407] Connection header received
0809 16:16:21.993460 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:21.993461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:21.993469 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:21.993502 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:21.994621 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.995091 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.996084 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.996273 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.996339 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:21.998528 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:21.998529 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:21.998529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:21.998535 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:21.999765 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:22.000201 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:22.000202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:22.000202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:22.000246 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:22.000477 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:22.000477 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:22.000478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:22.000568 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:22.000609 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:22.000910 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 16:16:22.000967 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:16:22.001276 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:21.992557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:54417)
0809 16:16:21.992783 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:21.992821 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:21.993379 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:21.993574 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:21.993578 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:21.994283 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:21.994536 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:21.994543 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.995174 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.995175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:21.996006 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:21.996009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:21.996356 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:21.996357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:21.996466 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:21.996893 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:21.996900 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:21.998442 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:21.999835 (+ 1393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:21.999842 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:21.999845 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:22.000135 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:22.000297 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:22.000298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:22.000298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:22.000420 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:22.000616 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:22.000622 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:22.000776 (+ 154us) client_negotiation.cc:769] Sending connection context
0809 16:16:22.000901 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 16:16:22.001062 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
I20260809 16:16:22.001724 9897 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42329
I20260809 16:16:22.001817 9897 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:22.001992 9897 heartbeater.cc:511] Master 127.27.217.62:42329 requested a full tablet report, sending...
I20260809 16:16:22.002315 9342 ts_manager.cc:194] Registered new tserver with Master: 043c3d4554ce4daeb876763eb9e342a7 (127.27.217.2:40559)
I20260809 16:16:22.002745 9342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:54417
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:16:22.018496 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42329
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:22.097615 9908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:22.097862 9908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:22.097888 9908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:22.099076 9908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:22.099116 9908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:22.099141 9908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:22.100590 9908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:22.100811 9908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:22.101023 9908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:22.105664 9919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:22.105669 9922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:22.105669 9920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:22.105885 9908 server_base.cc:1034] running on GCE node
I20260809 16:16:22.106163 9908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:22.106387 9908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:22.107524 9908 hybrid_clock.cc:648] HybridClock initialized: now 1786292182107510 us; error 31 us; skew 500 ppm
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:22.109973 9908 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:16:22.110409 9908 webserver.cc:460] Webserver started at http://127.27.217.3:32921/ using document root <none> and password file <none>
I20260809 16:16:22.110612 9908 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:22.110659 9908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:22.110785 9908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:22.111858 9908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "eb15fefaa4a4497fa3ef6b400ef02a00"
format_stamp: "Formatted at 2026-08-09 16:16:22 on dist-test-slave-nj21"
server_key: "8b808111392a7a0e7be6fd66b5e747d3"
server_key_iv: "6dd483987ad411e71d22f983a828c02b"
server_key_version: "encryptionkey@0"
I20260809 16:16:22.112195 9908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "eb15fefaa4a4497fa3ef6b400ef02a00"
format_stamp: "Formatted at 2026-08-09 16:16:22 on dist-test-slave-nj21"
server_key: "8b808111392a7a0e7be6fd66b5e747d3"
server_key_iv: "6dd483987ad411e71d22f983a828c02b"
server_key_version: "encryptionkey@0"
I20260809 16:16:22.113454 9908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:22.114125 9932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.114279 9908 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:22.114368 9908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "eb15fefaa4a4497fa3ef6b400ef02a00"
format_stamp: "Formatted at 2026-08-09 16:16:22 on dist-test-slave-nj21"
server_key: "8b808111392a7a0e7be6fd66b5e747d3"
server_key_iv: "6dd483987ad411e71d22f983a828c02b"
server_key_version: "encryptionkey@0"
I20260809 16:16:22.114434 9908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:22.121719 9908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:22.123394 9908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:22.123521 9908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:22.123754 9908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:22.124047 9908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:22.124081 9908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.124109 9908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:22.124127 9908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.129667 9908 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:46471
I20260809 16:16:22.129724 10123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:46471 every 8 connection(s)
I20260809 16:16:22.130002 9908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:22.132669 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 9908
I20260809 16:16:22.132771 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:22.132951 28516 external_mini_cluster.cc:1428] Setting key a1aaab3b1300502451ccd74c9fcd6df9
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:22.138692 9409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.130640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:47385 (local address 127.27.217.62:42329)
0809 16:16:22.130684 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.130686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.130896 (+ 210us) server_negotiation.cc:407] Connection header received
0809 16:16:22.131356 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.131358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.131367 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.131421 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.132339 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.132891 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.134098 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.134304 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.134358 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.136353 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:22.136355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:22.136355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:22.136362 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:22.137480 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:22.137851 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:22.137852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:22.137852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:22.137903 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:22.138117 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:22.138118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:22.138118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:22.138219 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:22.138276 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:22.138521 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 16:16:22.138605 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:16:22.138859 10127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.130601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:47385)
0809 16:16:22.130766 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.130807 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.131282 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.131472 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.131475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.132046 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.132232 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.132236 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.132985 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.132987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.134022 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.134025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.134380 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.134381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.134494 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.134905 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.134912 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.136277 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:22.137550 (+ 1273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:22.137556 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:22.137558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:22.137764 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:22.137959 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:22.137959 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:22.137960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:22.138063 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:22.138272 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:22.138278 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:22.138410 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 16:16:22.138495 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 16:16:22.138645 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260809 16:16:22.139227 10124 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42329
I20260809 16:16:22.139312 10124 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:22.139482 10124 heartbeater.cc:511] Master 127.27.217.62:42329 requested a full tablet report, sending...
I20260809 16:16:22.139865 9342 ts_manager.cc:194] Registered new tserver with Master: eb15fefaa4a4497fa3ef6b400ef02a00 (127.27.217.3:46471)
I20260809 16:16:22.140225 9342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:47385
I20260809 16:16:22.144527 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab.
Entry for principal oryx/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab.
WARNING: no policy specified for oryx/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab.
Entry for principal oryx/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab.
WARNING: no policy specified for oryx/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab.
Entry for principal oryx/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab.
I20260809 16:16:22.206794 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 9446
I20260809 16:16:22.239645 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 9688
I20260809 16:16:22.250301 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 9908
I20260809 16:16:22.260980 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 9297
I20260809 16:16:22.268514 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:42329
--webserver_interface=127.27.217.62
--webserver_port=44883
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:42329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:22.346994 10138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:22.347189 10138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:22.347209 10138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:22.348354 10138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:22.348402 10138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:22.348415 10138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:22.348426 10138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:22.348439 10138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:22.349910 10138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:42329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:42329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=44883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:22.350131 10138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:22.350348 10138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:22.354799 10146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:22.354820 10138 server_base.cc:1034] running on GCE node
W20260809 16:16:22.354831 10148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:22.354897 10151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:22.355232 10138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:22.355515 10138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:22.356644 10138 hybrid_clock.cc:648] HybridClock initialized: now 1786292182356620 us; error 42 us; skew 500 ppm
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:22.359028 10138 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:16:22.359444 10138 webserver.cc:460] Webserver started at http://127.27.217.62:44883/ using document root <none> and password file <none>
I20260809 16:16:22.359637 10138 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:22.359726 10138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:22.361001 10138 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:22.361632 10165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.361791 10138 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:22.361876 10138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "465b354d5c3242f78de27ef9e70cd46d"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "78fb712e181b86ff7f035871639f5b04"
server_key_iv: "492e444087522a1f0e248743931a0140"
server_key_version: "encryptionkey@0"
I20260809 16:16:22.362185 10138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:22.383522 10138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:22.385547 10138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:22.385679 10138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:22.389513 10138 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:42329
I20260809 16:16:22.389551 10255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:42329 every 8 connection(s)
I20260809 16:16:22.389894 10138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:22.391278 10256 sys_catalog.cc:263] Verifying existing consensus state
I20260809 16:16:22.391937 10256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Bootstrap starting.
I20260809 16:16:22.393106 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 10138
I20260809 16:16:22.393366 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:37841
--local_ip_for_outbound_sockets=127.27.217.1
--tserver_master_addrs=127.27.217.62:42329
--webserver_port=39439
--webserver_interface=127.27.217.1
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.217.1
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:16:22.400323 10256 log.cc:824] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:22.402074 10256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:16:22.402343 10256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Bootstrap complete.
I20260809 16:16:22.404557 10256 raft_consensus.cc:348] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } }
I20260809 16:16:22.404783 10256 raft_consensus.cc:729] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 465b354d5c3242f78de27ef9e70cd46d, State: Initialized, Role: FOLLOWER
I20260809 16:16:22.404933 10256 consensus_queue.cc:260] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } }
I20260809 16:16:22.404994 10256 raft_consensus.cc:388] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:22.405036 10256 raft_consensus.cc:482] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:22.405086 10256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 1 FOLLOWER]: Advancing to term 2
I20260809 16:16:22.406064 10256 raft_consensus.cc:504] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } }
I20260809 16:16:22.406155 10256 leader_election.cc:302] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 465b354d5c3242f78de27ef9e70cd46d; no voters:
I20260809 16:16:22.406313 10256 leader_election.cc:288] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 16:16:22.406364 10262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 2 FOLLOWER]: Leader election won for term 2
I20260809 16:16:22.406530 10262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [term 2 LEADER]: Becoming Leader. State: Replica: 465b354d5c3242f78de27ef9e70cd46d, State: Running, Role: LEADER
I20260809 16:16:22.406584 10256 sys_catalog.cc:564] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:22.406692 10262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } }
I20260809 16:16:22.406936 10262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 465b354d5c3242f78de27ef9e70cd46d. Latest consensus state: current_term: 2 leader_uuid: "465b354d5c3242f78de27ef9e70cd46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } } }
I20260809 16:16:22.406994 10262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:22.407379 10264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "465b354d5c3242f78de27ef9e70cd46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465b354d5c3242f78de27ef9e70cd46d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42329 } } }
I20260809 16:16:22.407400 10269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:22.407438 10264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:22.407902 10269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:22.408109 10269 catalog_manager.cc:1259] Loaded cluster ID: 445707f483db4b8a926f357995e62c9f
I20260809 16:16:22.408295 10269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:22.409574 10269 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:22.409791 10269 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 465b354d5c3242f78de27ef9e70cd46d: Loaded TSK: 0
I20260809 16:16:22.410059 10269 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 16:16:22.474630 10258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:22.474815 10258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:22.474846 10258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:22.475981 10258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:22.476017 10258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:22.476051 10258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:22.477427 10258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.1.keytab
--principal=oryx/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:37841
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=39439
--tserver_master_addrs=127.27.217.62:42329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:22.477658 10258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:22.477854 10258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:22.482553 10306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:22.482553 10305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:22.482740 10308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:22.482676 10258 server_base.cc:1034] running on GCE node
I20260809 16:16:22.482956 10258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:22.483175 10258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:22.484314 10258 hybrid_clock.cc:648] HybridClock initialized: now 1786292182484301 us; error 29 us; skew 500 ppm
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292182, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:22.486883 10258 init.cc:377] Logged in from keytab as oryx/127.27.217.1@KRBTEST.COM (short username oryx)
I20260809 16:16:22.487409 10258 webserver.cc:460] Webserver started at http://127.27.217.1:39439/ using document root <none> and password file <none>
I20260809 16:16:22.487722 10258 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:22.487809 10258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:22.489617 10258 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:22.490216 10321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.490374 10258 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:22.490466 10258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "a38093c15c8b4d92b1a3b15ba723dd14"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "22daf5a62a41d8b5b586a27238b497d6"
server_key_iv: "4c43cac210aff54a24dccb5ffc3bd1f6"
server_key_version: "encryptionkey@0"
I20260809 16:16:22.490844 10258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:22.514678 10258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:22.516786 10258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:22.516907 10258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:22.517131 10258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:22.517474 10258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:22.517513 10258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.517534 10258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:22.517557 10258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.524340 10258 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:37841
I20260809 16:16:22.524377 10502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:37841 every 8 connection(s)
I20260809 16:16:22.524698 10258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:22.529623 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 10258
I20260809 16:16:22.529934 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:40559
--local_ip_for_outbound_sockets=127.27.217.2
--tserver_master_addrs=127.27.217.62:42329
--webserver_port=33709
--webserver_interface=127.27.217.2
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.217.2
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:22.533694 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.525375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:33337)
0809 16:16:22.525549 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.525590 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.526176 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.526552 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.526556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.527225 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.527483 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.527488 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.528651 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.528652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.529800 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.529803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.530552 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.530553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.530686 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.531187 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.531197 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.533556 (+ 2359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
W20260809 16:16:22.533918 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.525471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:33337 (local address 127.27.217.62:42329)
0809 16:16:22.525647 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.525655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.525682 (+ 27us) server_negotiation.cc:407] Connection header received
0809 16:16:22.526343 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.526348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.526387 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.526495 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.527624 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.528542 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.529900 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.530445 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.530548 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.533735 (+ 3187us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:33337: BlockingRecv error: recv got EOF from 127.27.217.1:33337 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
W20260809 16:16:22.533999 10504 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:42329 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.217.62:42329: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:22.538511 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.534217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:45911)
0809 16:16:22.534316 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.534324 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.534363 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.534482 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.534482 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.534587 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.534631 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.534632 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.535461 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.535462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.536038 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.536040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.536454 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.536454 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.536502 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.536902 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.536906 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.538448 (+ 1542us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260809 16:16:22.538573 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.534276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:45911 (local address 127.27.217.62:42329)
0809 16:16:22.534326 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.534327 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.534356 (+ 29us) server_negotiation.cc:407] Connection header received
0809 16:16:22.534402 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.534403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.534415 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.534470 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.534685 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.535377 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.536110 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.536386 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.536455 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.538524 (+ 2069us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:45911: BlockingRecv error: recv got EOF from 127.27.217.1:45911 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:22.542822 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.538830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:54107)
0809 16:16:22.538871 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.538881 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.538917 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.539067 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.539068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.539172 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.539197 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.539198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.540018 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.540019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.540480 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.540482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.540890 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.540890 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.540923 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.541275 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.541279 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.542781 (+ 1502us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:16:22.542930 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.538903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:54107 (local address 127.27.217.62:42329)
0809 16:16:22.538956 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.538958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.538966 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:22.538985 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.538987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.538997 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.539050 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.539264 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.539944 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.540547 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.540813 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.540887 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.542877 (+ 1990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:54107: BlockingRecv error: recv got EOF from 127.27.217.1:54107 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260809 16:16:22.542958 10504 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 16:16:22.611488 10513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:22.611688 10513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:22.611711 10513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:22.612787 10513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:22.612818 10513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:22.612841 10513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:22.614172 10513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.2.keytab
--principal=oryx/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:40559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=33709
--tserver_master_addrs=127.27.217.62:42329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:22.614351 10513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:22.614524 10513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:22.619172 10525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:22.619180 10522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:22.619266 10513 server_base.cc:1034] running on GCE node
W20260809 16:16:22.619204 10523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:22.619614 10513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:22.619859 10513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:22.621002 10513 hybrid_clock.cc:648] HybridClock initialized: now 1786292182620993 us; error 32 us; skew 500 ppm
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292182, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:22.623627 10513 init.cc:377] Logged in from keytab as oryx/127.27.217.2@KRBTEST.COM (short username oryx)
I20260809 16:16:22.624070 10513 webserver.cc:460] Webserver started at http://127.27.217.2:33709/ using document root <none> and password file <none>
I20260809 16:16:22.624276 10513 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:22.624338 10513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:22.625646 10513 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:22.626178 10535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.626310 10513 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:22.626389 10513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "043c3d4554ce4daeb876763eb9e342a7"
format_stamp: "Formatted at 2026-08-09 16:16:21 on dist-test-slave-nj21"
server_key: "0694d4091652e04b97b2e6f3a3504922"
server_key_iv: "3d0053f71f6d03fa16a72b7b65686661"
server_key_version: "encryptionkey@0"
I20260809 16:16:22.626667 10513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:22.649945 10513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:22.652091 10513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:22.652225 10513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:22.652441 10513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:22.652732 10513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:22.652766 10513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.652794 10513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:22.652819 10513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.658382 10513 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:40559
I20260809 16:16:22.658427 10719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:40559 every 8 connection(s)
I20260809 16:16:22.658740 10513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:22.665464 10722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.659435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:47287)
0809 16:16:22.659580 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.659614 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.660113 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.660315 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.660318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.660859 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.661046 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.661050 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.661666 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.661667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.662427 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.662429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.662720 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.662721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.662809 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.663242 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.663249 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.665302 (+ 2053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
W20260809 16:16:22.665485 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.659449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:47287 (local address 127.27.217.62:42329)
0809 16:16:22.659492 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.659494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.659707 (+ 213us) server_negotiation.cc:407] Connection header received
0809 16:16:22.660193 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.660194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.660210 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.660264 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.661117 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.661605 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.662486 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.662661 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.662714 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.665434 (+ 2720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:47287: BlockingRecv error: recv got EOF from 127.27.217.2:47287 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 16:16:22.665680 10720 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:42329 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.217.62:42329: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
I20260809 16:16:22.667261 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 10513
I20260809 16:16:22.667550 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:46471
--local_ip_for_outbound_sockets=127.27.217.3
--tserver_master_addrs=127.27.217.62:42329
--webserver_port=32921
--webserver_interface=127.27.217.3
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.217.3
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:22.670077 10722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.665905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:32885)
0809 16:16:22.665995 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.666003 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.666042 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.666136 (+ 94us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.666137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.666241 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.666282 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.666283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.666866 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.666867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.667519 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.667521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.667984 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.667985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.668050 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.668388 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.668393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.670034 (+ 1641us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76}
W20260809 16:16:22.670200 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.665960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:32885 (local address 127.27.217.62:42329)
0809 16:16:22.666001 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.666003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.666032 (+ 29us) server_negotiation.cc:407] Connection header received
0809 16:16:22.666083 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.666083 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.666091 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.666134 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.666355 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.666790 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.667638 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.667915 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.667974 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.670136 (+ 2162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:32885: BlockingRecv error: recv got EOF from 127.27.217.2:32885 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:22.674141 10722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.670441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:50813)
0809 16:16:22.670481 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.670490 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.670524 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.670635 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.670635 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.670751 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.670774 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.670775 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.671332 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.671333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.671856 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.671858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.672149 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.672150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.672197 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.672552 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.672555 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.674085 (+ 1530us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 16:16:22.674224 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.670501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:50813 (local address 127.27.217.62:42329)
0809 16:16:22.670540 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.670542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.670561 (+ 19us) server_negotiation.cc:407] Connection header received
0809 16:16:22.670580 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.670581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.670589 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.670627 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.670835 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.671270 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.671920 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.672097 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.672146 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.674171 (+ 2025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:50813: BlockingRecv error: recv got EOF from 127.27.217.2:50813 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 16:16:22.674467 10720 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 16:16:22.748234 10724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:22.748432 10724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:22.748453 10724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:22.749572 10724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:22.749614 10724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:22.749637 10724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:22.751003 10724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/krb5kdc/oryx_127.27.217.3.keytab
--principal=oryx/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:46471
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=32921
--tserver_master_addrs=127.27.217.62:42329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:22.751209 10724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:22.751407 10724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:22.756193 10741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:22.756322 10724 server_base.cc:1034] running on GCE node
W20260809 16:16:22.756206 10738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:22.756397 10736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:22.756646 10724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:22.756850 10724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:22.758003 10724 hybrid_clock.cc:648] HybridClock initialized: now 1786292182757991 us; error 27 us; skew 500 ppm
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292182, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:22.760440 10724 init.cc:377] Logged in from keytab as oryx/127.27.217.3@KRBTEST.COM (short username oryx)
I20260809 16:16:22.760828 10724 webserver.cc:460] Webserver started at http://127.27.217.3:32921/ using document root <none> and password file <none>
I20260809 16:16:22.761019 10724 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:22.761080 10724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:22.762395 10724 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:22.762984 10752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.763135 10724 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:22.763222 10724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "eb15fefaa4a4497fa3ef6b400ef02a00"
format_stamp: "Formatted at 2026-08-09 16:16:22 on dist-test-slave-nj21"
server_key: "8b808111392a7a0e7be6fd66b5e747d3"
server_key_iv: "6dd483987ad411e71d22f983a828c02b"
server_key_version: "encryptionkey@0"
I20260809 16:16:22.763525 10724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:22.796566 10724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:22.798450 10724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:22.798588 10724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:22.798827 10724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:22.799126 10724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:22.799160 10724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.799188 10724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:22.799206 10724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:22.804875 10724 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:46471
I20260809 16:16:22.804931 10920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:46471 every 8 connection(s)
I20260809 16:16:22.805241 10724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 16:16:22.811976 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.805983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:53153 (local address 127.27.217.62:42329)
0809 16:16:22.806051 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.806053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.806249 (+ 196us) server_negotiation.cc:407] Connection header received
0809 16:16:22.806782 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.806783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.806793 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.806845 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.807845 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.808323 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.809206 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.809384 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.809427 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.811927 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:53153: BlockingRecv error: recv got EOF from 127.27.217.3:53153 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 16:16:22.811985 10923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.805972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:53153)
0809 16:16:22.806138 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.806173 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.806669 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.806916 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.806921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.807513 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.807769 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.807774 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.808388 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.808389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.809145 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.809147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.809436 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.809436 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.809536 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.809930 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.809938 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.811850 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
W20260809 16:16:22.812175 10921 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:42329 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.217.62:42329: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
I20260809 16:16:22.813390 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 10724
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:22.816371 10923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.812378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:38741)
0809 16:16:22.812420 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.812430 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.812466 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.812646 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.812646 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.812745 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.812803 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.812804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.813369 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.813370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.814019 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.814021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.814315 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.814316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.814376 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.814718 (+ 342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.814723 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.816313 (+ 1590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:16:22.816450 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.812523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:38741 (local address 127.27.217.62:42329)
0809 16:16:22.812562 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.812564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.812570 (+ 6us) server_negotiation.cc:407] Connection header received
0809 16:16:22.812587 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.812588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.812594 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.812638 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.812850 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.813299 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.814078 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.814258 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.814309 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.816401 (+ 2092us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:38741: BlockingRecv error: recv got EOF from 127.27.217.3:38741 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:22 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:22.820535 10926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.813740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33194 (local address 127.27.217.62:42329)
0809 16:16:22.813875 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.813876 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.813946 (+ 70us) server_negotiation.cc:407] Connection header received
0809 16:16:22.814015 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.814016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.814024 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.814080 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.814661 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.815139 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.816008 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.816240 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.816295 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.817517 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:22.817521 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:22.817521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:22.817533 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:22.819069 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:22.819431 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:22.819434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:22.819434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:22.819557 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:22.819808 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:22.819808 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:22.819809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:22.820078 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:22.820212 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:22.820337 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 16:16:22.820447 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260809 16:16:22.820611 10923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:22.816581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:35933)
0809 16:16:22.816691 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:22.816699 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:22.816744 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:22.816859 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:22.816860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:22.816985 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:22.817016 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.817018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.817585 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.817586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.818160 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:22.818162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.818567 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.818568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:22.818605 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.818902 (+ 297us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:22.818906 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:22.820554 (+ 1648us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
W20260809 16:16:22.820676 10512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:22.816646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:35933 (local address 127.27.217.62:42329)
0809 16:16:22.816687 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:22.816689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:22.816746 (+ 57us) server_negotiation.cc:407] Connection header received
0809 16:16:22.816792 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:22.816793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:22.816802 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:22.816846 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:22.817077 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.817512 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.818230 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:22.818499 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:22.818568 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:22.820630 (+ 2062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:35933: BlockingRecv error: recv got EOF from 127.27.217.3:35933 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260809 16:16:22.820787 10921 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 16:16:23 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:23 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:23.547770 10929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:23.543299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:40595)
0809 16:16:23.543413 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:23.543423 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:23.543469 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:23.543594 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:23.543595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:23.543806 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:23.543860 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:23.543862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.544498 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.544500 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:23.545170 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:23.545173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.545494 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.545495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:23.545531 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:23.545968 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:23.545973 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:23.547700 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":55,"threads_started":1}
W20260809 16:16:23.547835 10930 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:23.543361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:40595 (local address 127.27.217.62:42329)
0809 16:16:23.543475 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:23.543476 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:23.543503 (+ 27us) server_negotiation.cc:407] Connection header received
0809 16:16:23.543521 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:23.543522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:23.543531 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:23.543581 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:23.543914 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.544407 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.545231 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.545437 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.545488 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:23.547779 (+ 2291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:40595: BlockingRecv error: recv got EOF from 127.27.217.1:40595 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":53,"threads_started":1}
Aug 09 16:16:23 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:23 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:23.679751 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:23.674887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:45499)
0809 16:16:23.675024 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:23.675035 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:23.675105 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:23.675231 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:23.675231 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:23.675408 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:23.675458 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:23.675459 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.676170 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.676172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:23.676725 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:23.676727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.677060 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.677061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:23.677117 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:23.677602 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:23.677607 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:23.679641 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
W20260809 16:16:23.679805 10930 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:23.674944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45499 (local address 127.27.217.62:42329)
0809 16:16:23.675020 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:23.675022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:23.675091 (+ 69us) server_negotiation.cc:407] Connection header received
0809 16:16:23.675156 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:23.675157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:23.675169 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:23.675217 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:23.675530 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.676098 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.676803 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.677002 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.677057 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:23.679751 (+ 2694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:45499: BlockingRecv error: recv got EOF from 127.27.217.2:45499 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 09 16:16:23 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:23 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:23.825485 10933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:23.821154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:41505)
0809 16:16:23.821277 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:23.821288 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:23.821367 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:23.821501 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:23.821502 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:23.821676 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:23.821726 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:23.821728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.822358 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.822359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:23.822900 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:23.822903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.823220 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.823221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:23.823278 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:23.823723 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:23.823728 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:23.825395 (+ 1667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
W20260809 16:16:23.825546 10930 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:23.821204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:41505 (local address 127.27.217.62:42329)
0809 16:16:23.821251 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:23.821253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:23.821341 (+ 88us) server_negotiation.cc:407] Connection header received
0809 16:16:23.821424 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:23.821425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:23.821438 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:23.821488 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:23.821790 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.822280 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.822971 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:23.823161 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:23.823214 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:23.825491 (+ 2277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:41505: BlockingRecv error: recv got EOF from 127.27.217.3:41505 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 16:16:24 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:24 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:24.552537 10936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:24.548214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:34743)
0809 16:16:24.548354 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:24.548369 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:24.548437 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:24.548549 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:24.548550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:24.548713 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:24.548785 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:24.548786 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.549377 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.549377 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:24.549912 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:24.549914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.550196 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.550197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:24.550231 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:24.550646 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:24.550650 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:24.552477 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
W20260809 16:16:24.552649 10937 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:24.548284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:34743 (local address 127.27.217.62:42329)
0809 16:16:24.548392 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:24.548393 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:24.548420 (+ 27us) server_negotiation.cc:407] Connection header received
0809 16:16:24.548479 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:24.548479 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:24.548489 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:24.548538 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:24.548835 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.549325 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.549968 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.550148 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.550190 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:24.552569 (+ 2379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:34743: BlockingRecv error: recv got EOF from 127.27.217.1:34743 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":59,"threads_started":1}
Aug 09 16:16:24 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:24 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:24.685108 10938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:24.680505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:33293)
0809 16:16:24.680658 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:24.680670 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:24.680747 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:24.680897 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:24.680898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:24.681089 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:24.681141 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:24.681143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.681830 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.681832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:24.682368 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:24.682370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.682707 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.682708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:24.682762 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:24.683240 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:24.683245 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:24.685045 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":66,"threads_started":1}
W20260809 16:16:24.685184 10937 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:24.680591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:33293 (local address 127.27.217.62:42329)
0809 16:16:24.680656 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:24.680658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:24.680725 (+ 67us) server_negotiation.cc:407] Connection header received
0809 16:16:24.680817 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:24.680818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:24.680832 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:24.680887 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:24.681220 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.681747 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.682449 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.682641 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.682711 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:24.685132 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:33293: BlockingRecv error: recv got EOF from 127.27.217.2:33293 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 16:16:24 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:24 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:24.830498 10939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:24.825978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:44633)
0809 16:16:24.826155 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:24.826168 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:24.826244 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:24.826384 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:24.826385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:24.826556 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:24.826605 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:24.826607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.827248 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.827249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:24.827828 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:24.827830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.828141 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.828142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:24.828208 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:24.828677 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:24.828682 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:24.830421 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
W20260809 16:16:24.830571 10937 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:24.826096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:44633 (local address 127.27.217.62:42329)
0809 16:16:24.826168 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:24.826170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:24.826231 (+ 61us) server_negotiation.cc:407] Connection header received
0809 16:16:24.826312 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:24.826313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:24.826325 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:24.826371 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:24.826690 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.827175 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.827904 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:24.828084 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:24.828135 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:24.830516 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:44633: BlockingRecv error: recv got EOF from 127.27.217.3:44633 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 16:16:25 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:25 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:25.557423 10943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:25.552998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:60603)
0809 16:16:25.553126 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:25.553136 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:25.553184 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:25.553308 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:25.553309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:25.553496 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:25.553563 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:25.553566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.554382 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.554382 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:25.554901 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:25.554903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.555191 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.555192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:25.555236 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:25.555663 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:25.555697 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:25.557344 (+ 1647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
W20260809 16:16:25.557513 10944 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:25.553059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:60603 (local address 127.27.217.62:42329)
0809 16:16:25.553176 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:25.553177 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:25.553187 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:25.553226 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:25.553227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:25.553237 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:25.553295 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:25.553633 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.554294 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.554955 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.555135 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.555175 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:25.557451 (+ 2276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:60603: BlockingRecv error: recv got EOF from 127.27.217.1:60603 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":60,"threads_started":1}
Aug 09 16:16:25 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:25 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:25.689738 10946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:25.685562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:56489)
0809 16:16:25.685705 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:25.685716 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:25.685771 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:25.685894 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:25.685895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:25.686050 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:25.686102 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:25.686103 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.686682 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.686683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:25.687184 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:25.687185 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.687449 (+ 264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.687450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:25.687486 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:25.687963 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:25.687968 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:25.689677 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":75,"threads_started":1}
W20260809 16:16:25.689867 10944 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:25.685603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:56489 (local address 127.27.217.62:42329)
0809 16:16:25.685646 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:25.685648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:25.685766 (+ 118us) server_negotiation.cc:407] Connection header received
0809 16:16:25.685813 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:25.685814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:25.685825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:25.685881 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:25.686147 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.686631 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.687231 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.687404 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.687446 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:25.689796 (+ 2350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:56489: BlockingRecv error: recv got EOF from 127.27.217.2:56489 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Aug 09 16:16:25 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:25 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:25.835120 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:25.830916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:56249)
0809 16:16:25.831057 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:25.831068 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:25.831135 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:25.831261 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:25.831262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:25.831445 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:25.831496 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:25.831498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.832164 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.832165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:25.832688 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:25.832690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.833013 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.833014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:25.833070 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:25.833458 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:25.833463 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:25.835058 (+ 1595us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
W20260809 16:16:25.835206 10944 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:25.830993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:56249 (local address 127.27.217.62:42329)
0809 16:16:25.831052 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:25.831054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:25.831124 (+ 70us) server_negotiation.cc:407] Connection header received
0809 16:16:25.831183 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:25.831184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:25.831198 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:25.831247 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:25.831564 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.832094 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.832757 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:25.832954 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:25.833008 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:25.835145 (+ 2137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:56249: BlockingRecv error: recv got EOF from 127.27.217.3:56249 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 09 16:16:26 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:26 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:26.562116 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:26.557846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:38609)
0809 16:16:26.557972 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:26.557982 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:26.558031 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:26.558163 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:26.558163 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:26.558321 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:26.558385 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:26.558387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.558984 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.558985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:26.559500 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:26.559501 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.559844 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.559845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:26.559905 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:26.560413 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:26.560417 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:26.562057 (+ 1640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":68,"threads_started":1}
W20260809 16:16:26.562212 10951 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:26.557948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:38609 (local address 127.27.217.62:42329)
0809 16:16:26.558056 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:26.558057 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:26.558065 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:26.558084 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:26.558085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:26.558095 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:26.558153 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:26.558434 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.558932 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.559550 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.559771 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.559831 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:26.562143 (+ 2312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:38609: BlockingRecv error: recv got EOF from 127.27.217.1:38609 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":53,"threads_started":1}
Aug 09 16:16:26 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:26 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:26.698216 10954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:26.690156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:41675)
0809 16:16:26.690336 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:26.690348 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:26.690417 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:26.690554 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:26.690555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:26.690727 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:26.690803 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:26.690805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.691457 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.691458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:26.692028 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:26.692031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.692360 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.692360 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:26.692430 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:26.696151 (+ 3721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:26.696156 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:26.698156 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
W20260809 16:16:26.698328 10951 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:26.690244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:41675 (local address 127.27.217.62:42329)
0809 16:16:26.690339 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:26.690341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:26.690422 (+ 81us) server_negotiation.cc:407] Connection header received
0809 16:16:26.690481 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:26.690482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:26.690495 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:26.690547 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:26.690883 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.691385 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.692100 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.692296 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.692350 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:26.698267 (+ 5917us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:41675: BlockingRecv error: recv got EOF from 127.27.217.2:41675 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 16:16:26 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:26 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:26.839771 10955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:26.835556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:56707)
0809 16:16:26.835702 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:26.835713 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:26.835784 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:26.835911 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:26.835912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:26.836083 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:26.836133 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:26.836135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.836760 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.836762 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:26.837284 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:26.837286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.837607 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.837608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:26.837665 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:26.838053 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:26.838058 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:26.839709 (+ 1651us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":66,"threads_started":1}
W20260809 16:16:26.839911 10951 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:26.835617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:56707 (local address 127.27.217.62:42329)
0809 16:16:26.835665 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:26.835693 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:26.835782 (+ 89us) server_negotiation.cc:407] Connection header received
0809 16:16:26.835833 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:26.835834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:26.835848 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:26.835895 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:26.836206 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.836693 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.837366 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:26.837548 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:26.837601 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:26.839798 (+ 2197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:56707: BlockingRecv error: recv got EOF from 127.27.217.3:56707 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 09 16:16:27 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:27 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:27.566880 10956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:27.562560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:53753)
0809 16:16:27.562682 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:27.562692 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:27.562750 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:27.562872 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:27.562872 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:27.563029 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:27.563078 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:27.563080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.563666 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.563682 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:27.564207 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:27.564208 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.564515 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.564515 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:27.564555 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:27.565028 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:27.565033 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:27.566819 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":67,"threads_started":1}
W20260809 16:16:27.567006 10957 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:27.562640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:53753 (local address 127.27.217.62:42329)
0809 16:16:27.562759 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:27.562761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:27.562770 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:27.562790 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:27.562791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:27.562801 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:27.562867 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:27.563124 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.563613 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.564270 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.564460 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.564510 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:27.566932 (+ 2422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:53753: BlockingRecv error: recv got EOF from 127.27.217.1:53753 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
Aug 09 16:16:27 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:27 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:27.704785 10959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:27.699872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:46409)
0809 16:16:27.700000 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:27.700010 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:27.700073 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:27.700200 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:27.700201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:27.700391 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:27.700444 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:27.700445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.701264 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.701265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:27.702091 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:27.702094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.702444 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.702445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:27.702500 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:27.702882 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:27.702885 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:27.704706 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":54,"threads_started":1}
W20260809 16:16:27.704862 10957 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:27.699980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:46409 (local address 127.27.217.62:42329)
0809 16:16:27.700022 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:27.700024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:27.700054 (+ 30us) server_negotiation.cc:407] Connection header received
0809 16:16:27.700132 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:27.700133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:27.700143 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:27.700191 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:27.700525 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.701191 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.702167 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.702382 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.702439 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:27.704800 (+ 2361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:46409: BlockingRecv error: recv got EOF from 127.27.217.2:46409 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 16:16:27 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:27 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:27.844719 10960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:27.840257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:43159)
0809 16:16:27.840426 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:27.840438 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:27.840498 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:27.840625 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:27.840626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:27.840797 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:27.840860 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:27.840863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.841592 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.841594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:27.842116 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:27.842118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.842452 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.842453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:27.842509 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:27.842929 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:27.842933 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:27.844639 (+ 1706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":110,"threads_started":1}
W20260809 16:16:27.844787 10957 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:27.840331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:43159 (local address 127.27.217.62:42329)
0809 16:16:27.840401 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:27.840403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:27.840496 (+ 93us) server_negotiation.cc:407] Connection header received
0809 16:16:27.840549 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:27.840550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:27.840565 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:27.840614 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:27.840935 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.841519 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.842189 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:27.842392 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:27.842446 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:27.844733 (+ 2287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:43159: BlockingRecv error: recv got EOF from 127.27.217.3:43159 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 16:16:28 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:28 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:28.571619 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:28.567379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:34063)
0809 16:16:28.567511 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:28.567535 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:28.567592 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:28.567720 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:28.567721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:28.567896 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:28.567947 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:28.567949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.568565 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.568566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:28.569090 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:28.569091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.569394 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.569396 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:28.569441 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:28.569865 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:28.569869 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:28.571559 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
W20260809 16:16:28.571785 10962 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:28.567433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:34063 (local address 127.27.217.62:42329)
0809 16:16:28.567531 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:28.567533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:28.567591 (+ 58us) server_negotiation.cc:407] Connection header received
0809 16:16:28.567642 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:28.567643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:28.567653 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:28.567712 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:28.568003 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.568507 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.569144 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.569330 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.569372 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:28.571662 (+ 2290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:34063: BlockingRecv error: recv got EOF from 127.27.217.1:34063 (error 108)
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":48,"threads_started":1}
Aug 09 16:16:28 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:28 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:28.709733 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:28.705224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:42785)
0809 16:16:28.705401 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:28.705413 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:28.705487 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:28.705616 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:28.705617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:28.705806 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:28.705859 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:28.705861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.706565 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.706566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:28.707147 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:28.707150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.707485 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.707486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:28.707544 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:28.708014 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:28.708017 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:28.709673 (+ 1656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":127,"threads_started":1}
W20260809 16:16:28.709843 10962 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:28.705329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:42785 (local address 127.27.217.62:42329)
0809 16:16:28.705405 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:28.705408 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:28.705472 (+ 64us) server_negotiation.cc:407] Connection header received
0809 16:16:28.705545 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:28.705546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:28.705558 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:28.705606 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:28.705947 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.706492 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.707235 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.707425 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.707479 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:28.709772 (+ 2293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:42785: BlockingRecv error: recv got EOF from 127.27.217.2:42785 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 16:16:28 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:28 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:28.849762 10966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:28.845174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:43705)
0809 16:16:28.845330 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:28.845340 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:28.845401 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:28.845523 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:28.845524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:28.845687 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:28.845738 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:28.845739 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.846417 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.846418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:28.846955 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:28.846957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.847307 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.847308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:28.847350 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:28.847836 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:28.847840 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:28.849700 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
W20260809 16:16:28.849884 10962 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:28.845269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:43705 (local address 127.27.217.62:42329)
0809 16:16:28.845331 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:28.845333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:28.845398 (+ 65us) server_negotiation.cc:407] Connection header received
0809 16:16:28.845442 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:28.845443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:28.845457 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:28.845513 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:28.845820 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.846343 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.847025 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:28.847237 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:28.847296 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:28.849820 (+ 2524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:43705: BlockingRecv error: recv got EOF from 127.27.217.3:43705 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 16:16:29 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:29 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:29.577390 10967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:29.572030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:59601)
0809 16:16:29.572148 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:29.572161 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:29.572217 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:29.572339 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:29.572340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:29.572498 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:29.572549 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:29.572550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.573323 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.573325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:29.574129 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:29.574133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.574558 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.574559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:29.574635 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:29.575119 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:29.575124 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:29.577293 (+ 2169us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
W20260809 16:16:29.577543 10968 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:29.572092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:59601 (local address 127.27.217.62:42329)
0809 16:16:29.572214 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:29.572215 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:29.572224 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:29.572262 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:29.572263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:29.572273 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:29.572329 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:29.572598 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.573246 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.574200 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.574483 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.574549 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:29.577386 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:59601: BlockingRecv error: recv got EOF from 127.27.217.1:59601 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":63,"threads_started":1}
Aug 09 16:16:29 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:29 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:29.714609 10969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:29.710162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:33015)
0809 16:16:29.710298 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:29.710308 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:29.710358 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:29.710489 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:29.710490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:29.710653 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:29.710705 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:29.710707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.711348 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.711348 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:29.711918 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:29.711921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.712237 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.712237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:29.712273 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:29.712651 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:29.712655 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:29.714538 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
W20260809 16:16:29.714682 10968 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:29.710264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:33015 (local address 127.27.217.62:42329)
0809 16:16:29.710323 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:29.710325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:29.710349 (+ 24us) server_negotiation.cc:407] Connection header received
0809 16:16:29.710410 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:29.710411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:29.710422 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:29.710480 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:29.710777 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.711276 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.711984 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.712179 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.712238 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:29.714623 (+ 2385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:33015: BlockingRecv error: recv got EOF from 127.27.217.2:33015 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 16:16:29 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:29 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:29.854611 10970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:29.850232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:34859)
0809 16:16:29.850398 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:29.850408 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:29.850461 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:29.850576 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:29.850577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:29.850734 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:29.850785 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:29.850786 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.851363 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.851364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:29.851994 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:29.851997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.852355 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.852356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:29.852396 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:29.852777 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:29.852781 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:29.854549 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
W20260809 16:16:29.854743 10968 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:29.850312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:34859 (local address 127.27.217.62:42329)
0809 16:16:29.850361 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:29.850363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:29.850448 (+ 85us) server_negotiation.cc:407] Connection header received
0809 16:16:29.850511 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:29.850512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:29.850525 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:29.850560 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:29.850832 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.851312 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.852061 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:29.852294 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:29.852341 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:29.854645 (+ 2304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:34859: BlockingRecv error: recv got EOF from 127.27.217.3:34859 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 09 16:16:30 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:30 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:30.582257 10976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:30.577833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:58715)
0809 16:16:30.577974 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:30.577984 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:30.578037 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:30.578218 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:30.578219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:30.578449 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:30.578519 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:30.578522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.579213 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.579214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:30.579782 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:30.579784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.580080 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.580080 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:30.580117 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:30.580544 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:30.580549 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:30.582197 (+ 1648us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
W20260809 16:16:30.582371 10977 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:30.577954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:58715 (local address 127.27.217.62:42329)
0809 16:16:30.578077 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:30.578079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:30.578086 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:16:30.578108 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:30.578109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:30.578118 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:30.578202 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:30.578605 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.579153 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.579847 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.580030 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.580076 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:30.582294 (+ 2218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:58715: BlockingRecv error: recv got EOF from 127.27.217.1:58715 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
Aug 09 16:16:30 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:30 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:30.720193 10981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:30.715117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:45889)
0809 16:16:30.715284 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:30.715296 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:30.715371 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:30.715521 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:30.715522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:30.715804 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:30.715862 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:30.715865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.716709 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.716711 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:30.717304 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:30.717307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.717695 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.717696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:30.717767 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:30.718186 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:30.718191 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:30.720114 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":77,"threads_started":1}
W20260809 16:16:30.720286 10977 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:30.715202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45889 (local address 127.27.217.62:42329)
0809 16:16:30.715266 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:30.715268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:30.715356 (+ 88us) server_negotiation.cc:407] Connection header received
0809 16:16:30.715445 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:30.715446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:30.715460 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:30.715516 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:30.715945 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.716611 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.717387 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.717625 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.717692 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:30.720231 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:45889: BlockingRecv error: recv got EOF from 127.27.217.2:45889 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 16:16:30 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:30 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:30.859588 10982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:30.855104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:45263)
0809 16:16:30.855261 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:30.855273 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:30.855337 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:30.855487 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:30.855488 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:30.855665 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:30.855775 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:30.855778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.856403 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.856404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:30.856939 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:30.856940 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.857269 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.857269 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:30.857311 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:30.857710 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:30.857715 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:30.859512 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
W20260809 16:16:30.859645 10977 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:30.855222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:45263 (local address 127.27.217.62:42329)
0809 16:16:30.855294 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:30.855296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:30.855322 (+ 26us) server_negotiation.cc:407] Connection header received
0809 16:16:30.855395 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:30.855396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:30.855410 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:30.855473 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:30.855840 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.856338 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.857011 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:30.857195 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:30.857261 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:30.859595 (+ 2334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:45263: BlockingRecv error: recv got EOF from 127.27.217.3:45263 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 16:16:31 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:31 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:31.586895 10984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:31.582657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:55497)
0809 16:16:31.582795 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:31.582807 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:31.582893 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:31.583020 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:31.583020 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:31.583187 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:31.583238 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:31.583240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.583849 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.583849 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:31.584373 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:31.584374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.584646 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.584647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:31.584683 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:31.585113 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:31.585117 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:31.586816 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":60,"threads_started":1}
W20260809 16:16:31.587033 10985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:31.582726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:55497 (local address 127.27.217.62:42329)
0809 16:16:31.582872 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:31.582874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:31.582883 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:31.582942 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:31.582943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:31.582952 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:31.583005 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:31.583288 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.583793 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.584427 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.584602 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.584643 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:31.586951 (+ 2308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:55497: BlockingRecv error: recv got EOF from 127.27.217.1:55497 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
Aug 09 16:16:31 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:31 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:31.727232 10986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:31.720638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:36857)
0809 16:16:31.720788 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:31.720798 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:31.720858 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:31.720963 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:31.720964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:31.721125 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:31.721177 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:31.721178 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.721752 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.721753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:31.722266 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:31.722267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.722542 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.722543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:31.722586 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:31.725395 (+ 2809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:31.725400 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:31.727159 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":94,"threads_started":1}
W20260809 16:16:31.727316 10985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:31.720705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:36857 (local address 127.27.217.62:42329)
0809 16:16:31.720781 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:31.720783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:31.720856 (+ 73us) server_negotiation.cc:407] Connection header received
0809 16:16:31.720910 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:31.720911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:31.720921 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:31.720958 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:31.721221 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.721702 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.722317 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.722490 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.722532 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:31.727255 (+ 4723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:36857: BlockingRecv error: recv got EOF from 127.27.217.2:36857 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 16:16:31 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:31 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:31.864599 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:31.860076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:56541)
0809 16:16:31.860252 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:31.860265 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:31.860343 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:31.860470 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:31.860471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:31.860664 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:31.860715 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:31.860717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.861385 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.861386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:31.861923 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:31.861925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.862241 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.862242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:31.862300 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:31.862704 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:31.862709 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:31.864518 (+ 1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
W20260809 16:16:31.864708 10985 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:31.860182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:56541 (local address 127.27.217.62:42329)
0809 16:16:31.860246 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:31.860248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:31.860323 (+ 75us) server_negotiation.cc:407] Connection header received
0809 16:16:31.860394 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:31.860395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:31.860409 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:31.860455 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:31.860807 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.861309 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.861999 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:31.862182 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:31.862235 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:31.864644 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:56541: BlockingRecv error: recv got EOF from 127.27.217.3:56541 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 16:16:32 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:32 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:32.591519 10995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:32.587341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:50395)
0809 16:16:32.587501 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:32.587511 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:32.587571 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:32.587707 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:32.587707 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:32.587889 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:32.587942 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:32.587945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.588562 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.588563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:32.589087 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:32.589089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.589371 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.589371 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:32.589407 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:32.589817 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:32.589821 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:32.591459 (+ 1638us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
W20260809 16:16:32.591645 10992 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:32.587361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:50395 (local address 127.27.217.62:42329)
0809 16:16:32.587491 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:32.587493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:32.587566 (+ 73us) server_negotiation.cc:407] Connection header received
0809 16:16:32.587620 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:32.587620 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:32.587630 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:32.587694 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:32.587996 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.588502 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.589138 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.589316 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.589365 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:32.591566 (+ 2201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:50395: BlockingRecv error: recv got EOF from 127.27.217.1:50395 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
Aug 09 16:16:32 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:32 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:32.732111 10998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:32.727710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:37291)
0809 16:16:32.727853 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:32.727863 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:32.727923 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:32.728037 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:32.728038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:32.728203 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:32.728255 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:32.728257 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.728979 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.728980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:32.729516 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:32.729518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.729876 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.729877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:32.729917 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:32.730317 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:32.730321 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:32.732050 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
W20260809 16:16:32.732208 10992 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:32.727751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:37291 (local address 127.27.217.62:42329)
0809 16:16:32.727842 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:32.727844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:32.727920 (+ 76us) server_negotiation.cc:407] Connection header received
0809 16:16:32.727978 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:32.727978 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:32.727989 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:32.728029 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:32.728343 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.728916 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.729593 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.729823 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.729877 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:32.732149 (+ 2272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:37291: BlockingRecv error: recv got EOF from 127.27.217.2:37291 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 16:16:32 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:32 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:32.869369 10999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:32.865135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:53905)
0809 16:16:32.865282 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:32.865291 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:32.865340 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:32.865454 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:32.865455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:32.865620 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:32.865672 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:32.865674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.866324 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.866325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:32.866879 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:32.866880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.867182 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.867183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:32.867220 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:32.867641 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:32.867645 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:32.869291 (+ 1646us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":73,"threads_started":1}
W20260809 16:16:32.869421 10992 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:32.865231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:53905 (local address 127.27.217.62:42329)
0809 16:16:32.865287 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:32.865289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:32.865327 (+ 38us) server_negotiation.cc:407] Connection header received
0809 16:16:32.865384 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:32.865385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:32.865396 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:32.865443 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:32.865719 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.866252 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.866937 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:32.867133 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:32.867180 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:32.869369 (+ 2189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:53905: BlockingRecv error: recv got EOF from 127.27.217.3:53905 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 09 16:16:33 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:33 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:33.596369 11000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:33.591975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:59009)
0809 16:16:33.592110 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:33.592122 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:33.592185 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:33.592297 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:33.592298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:33.592472 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:33.592522 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:33.592523 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.593139 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.593139 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:33.593681 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:33.593682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.593965 (+ 283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.593966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:33.594003 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:33.594459 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:33.594463 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:33.596298 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
W20260809 16:16:33.596457 11002 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:33.592058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:59009 (local address 127.27.217.62:42329)
0809 16:16:33.592187 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:33.592189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:33.592197 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:33.592221 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:33.592222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:33.592231 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:33.592287 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:33.592580 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.593086 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.593733 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.593917 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.593959 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:33.596386 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:59009: BlockingRecv error: recv got EOF from 127.27.217.1:59009 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
Aug 09 16:16:33 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:33 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:33.736865 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:33.732523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:38359)
0809 16:16:33.732640 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:33.732651 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:33.732723 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:33.732871 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:33.732872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:33.733050 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:33.733099 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:33.733100 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.733727 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.733728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:33.734268 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:33.734270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.734603 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.734604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:33.734659 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:33.735034 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:33.735038 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:33.736775 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":67,"threads_started":1}
W20260809 16:16:33.736936 11002 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:33.732561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:38359 (local address 127.27.217.62:42329)
0809 16:16:33.732613 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:33.732615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:33.732711 (+ 96us) server_negotiation.cc:407] Connection header received
0809 16:16:33.732778 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:33.732779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:33.732791 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:33.732853 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:33.733166 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.733659 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.734342 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.734545 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.734600 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:33.736881 (+ 2281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:38359: BlockingRecv error: recv got EOF from 127.27.217.2:38359 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 16:16:33 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:33 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:33.873966 11005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:33.869818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:53197)
0809 16:16:33.870001 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:33.870011 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:33.870068 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:33.870188 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:33.870189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:33.870358 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:33.870405 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:33.870407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.870990 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.870990 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:33.871517 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:33.871518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.871795 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.871796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:33.871838 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:33.872215 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:33.872219 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:33.873896 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":113,"threads_started":1}
W20260809 16:16:33.874043 11002 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:33.869882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:53197 (local address 127.27.217.62:42329)
0809 16:16:33.869935 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:33.869937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:33.870068 (+ 131us) server_negotiation.cc:407] Connection header received
0809 16:16:33.870124 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:33.870125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:33.870138 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:33.870182 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:33.870456 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.870939 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.871571 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:33.871757 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:33.871797 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:33.873984 (+ 2187us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:53197: BlockingRecv error: recv got EOF from 127.27.217.3:53197 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 16:16:34 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:34 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:34.601101 11007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:34.596793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:35221)
0809 16:16:34.596940 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:34.596949 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:34.597001 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:34.597128 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:34.597128 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:34.597304 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:34.597379 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:34.597382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.597988 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.597988 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:34.598572 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:34.598575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.598855 (+ 280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.598855 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:34.598891 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:34.599329 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:34.599334 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:34.601030 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
W20260809 16:16:34.601183 11008 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:34.596878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:35221 (local address 127.27.217.62:42329)
0809 16:16:34.596992 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:34.596994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:34.597003 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:34.597044 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:34.597045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:34.597055 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:34.597115 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:34.597437 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.597936 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.598630 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.598807 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.598855 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:34.601117 (+ 2262us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:35221: BlockingRecv error: recv got EOF from 127.27.217.1:35221 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":51,"threads_started":1}
Aug 09 16:16:34 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:34 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:34.741776 11009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:34.737305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:56989)
0809 16:16:34.737442 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:34.737454 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:34.737527 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:34.737660 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:34.737661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:34.737841 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:34.737889 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:34.737891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.738523 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.738525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:34.739066 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:34.739068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.739395 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.739395 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:34.739453 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:34.739866 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:34.739870 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:34.741684 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
W20260809 16:16:34.741873 11008 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:34.737395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:56989 (local address 127.27.217.62:42329)
0809 16:16:34.737465 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:34.737467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:34.737516 (+ 49us) server_negotiation.cc:407] Connection header received
0809 16:16:34.737587 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:34.737588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:34.737601 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:34.737644 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:34.737960 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.738455 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.739145 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.739336 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.739392 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:34.741809 (+ 2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:56989: BlockingRecv error: recv got EOF from 127.27.217.2:56989 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 16:16:34 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:34 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:34.878871 11010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:34.874421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:56903)
0809 16:16:34.874545 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:34.874558 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:34.874627 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:34.874761 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:34.874762 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:34.874956 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:34.875002 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:34.875004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.875650 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.875652 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:34.876209 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:34.876211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.876537 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.876538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:34.876594 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:34.877007 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:34.877011 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:34.878775 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":69,"threads_started":1}
W20260809 16:16:34.879169 11008 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:34.874497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:56903 (local address 127.27.217.62:42329)
0809 16:16:34.874565 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:34.874567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:34.874618 (+ 51us) server_negotiation.cc:407] Connection header received
0809 16:16:34.874682 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:34.874683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:34.874697 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:34.874741 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:34.875075 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.875580 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.876284 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:34.876478 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:34.876532 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:34.879110 (+ 2578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:56903: BlockingRecv error: recv got EOF from 127.27.217.3:56903 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 16:16:35 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:35 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:35.605798 11012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:35.601552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:34911)
0809 16:16:35.601679 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:35.601690 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:35.601747 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:35.601887 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:35.601888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:35.602055 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:35.602106 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:35.602108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.602699 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.602700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:35.603204 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:35.603205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.603493 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.603494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:35.603528 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:35.603924 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:35.603929 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:35.605716 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
W20260809 16:16:35.605970 11013 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:35.601616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:34911 (local address 127.27.217.62:42329)
0809 16:16:35.601771 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:35.601773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:35.601782 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:35.601802 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:35.601803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:35.601813 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:35.601872 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:35.602158 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.602650 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.603262 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.603445 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.603490 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:35.605838 (+ 2348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:34911: BlockingRecv error: recv got EOF from 127.27.217.1:34911 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":59,"threads_started":1}
Aug 09 16:16:35 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:35 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:35.746433 11014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:35.742224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:45855)
0809 16:16:35.742362 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:35.742372 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:35.742427 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:35.742543 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:35.742544 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:35.742712 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:35.742762 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:35.742763 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.743378 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.743378 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:35.743973 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:35.743976 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.744323 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.744324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:35.744385 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:35.744802 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:35.744805 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:35.746346 (+ 1541us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":59,"threads_started":1}
W20260809 16:16:35.746503 11013 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:35.742335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45855 (local address 127.27.217.62:42329)
0809 16:16:35.742381 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:35.742383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:35.742415 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:16:35.742481 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:35.742482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:35.742492 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:35.742531 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:35.742823 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.743318 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.744045 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.744262 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.744319 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:35.746448 (+ 2129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:45855: BlockingRecv error: recv got EOF from 127.27.217.2:45855 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 16:16:35 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:35 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:35.883749 11016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:35.879334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:44949)
0809 16:16:35.879512 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:35.879523 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:35.879585 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:35.879757 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:35.879758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:35.879940 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:35.879985 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:35.879987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.880622 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.880623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:35.881166 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:35.881168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.881484 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.881485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:35.881542 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:35.881978 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:35.881983 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:35.883631 (+ 1648us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":102,"threads_started":1}
W20260809 16:16:35.883817 11013 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:35.879415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:44949 (local address 127.27.217.62:42329)
0809 16:16:35.879475 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:35.879477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:35.879578 (+ 101us) server_negotiation.cc:407] Connection header received
0809 16:16:35.879636 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:35.879637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:35.879651 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:35.879742 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:35.880055 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.880551 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.881240 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:35.881425 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:35.881478 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:35.883762 (+ 2284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:44949: BlockingRecv error: recv got EOF from 127.27.217.3:44949 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 09 16:16:36 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:36 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:36.610611 11017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:36.606202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:47829)
0809 16:16:36.606327 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:36.606348 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:36.606408 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:36.606589 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:36.606591 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:36.606791 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:36.606843 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:36.606845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.607552 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.607553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:36.608120 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:36.608122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.608441 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.608442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:36.608486 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:36.608880 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:36.608884 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:36.610554 (+ 1670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
W20260809 16:16:36.610711 11023 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:36.606250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:47829 (local address 127.27.217.62:42329)
0809 16:16:36.606367 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:36.606369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:36.606395 (+ 26us) server_negotiation.cc:407] Connection header received
0809 16:16:36.606447 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:36.606448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:36.606458 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:36.606516 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:36.606921 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.607487 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.608179 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.608386 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.608432 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:36.610641 (+ 2209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:47829: BlockingRecv error: recv got EOF from 127.27.217.1:47829 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
Aug 09 16:16:36 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:36 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:36.753883 11024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:36.746931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:35853)
0809 16:16:36.747096 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:36.747106 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:36.747169 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:36.747303 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:36.747304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:36.747487 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:36.747543 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:36.747544 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.748203 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.748205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:36.748790 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:36.748793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.749085 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.749085 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:36.749123 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:36.752035 (+ 2912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:36.752040 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:36.753790 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":75,"threads_started":1}
W20260809 16:16:36.753947 11023 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:36.746995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:35853 (local address 127.27.217.62:42329)
0809 16:16:36.747041 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:36.747043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:36.747160 (+ 117us) server_negotiation.cc:407] Connection header received
0809 16:16:36.747227 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:36.747228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:36.747238 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:36.747286 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:36.747596 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.748112 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.748858 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.749034 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.749076 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:36.753894 (+ 4818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:35853: BlockingRecv error: recv got EOF from 127.27.217.2:35853 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 16:16:36 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:36 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.3@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:36.888362 11025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:36.884182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.3:57297)
0809 16:16:36.884316 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:36.884327 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:36.884391 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:36.884520 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:36.884522 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:36.884701 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:36.884748 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:36.884750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.885367 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.885368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:36.885891 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:36.885893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.886199 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.886200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:36.886253 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:36.886643 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:36.886648 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:36.888285 (+ 1637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":71,"threads_started":1}
W20260809 16:16:36.888437 11023 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:36.884245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:57297 (local address 127.27.217.62:42329)
0809 16:16:36.884300 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:36.884302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:36.884379 (+ 77us) server_negotiation.cc:407] Connection header received
0809 16:16:36.884447 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:36.884448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:36.884462 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:36.884508 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:36.884812 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.885298 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.885960 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:36.886142 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:36.886193 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:36.888382 (+ 2189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.3:57297: BlockingRecv error: recv got EOF from 127.27.217.3:57297 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 09 16:16:37 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:37 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.1@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:37.616346 11026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:37.611156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.1:41925)
0809 16:16:37.611295 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:37.611306 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:37.611370 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:37.611522 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:37.611522 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:37.611703 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:37.611758 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:37.611760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.612692 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.612693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:37.613213 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:37.613214 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.613675 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.613675 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:37.613711 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:37.614205 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:37.614210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:37.616264 (+ 2054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
W20260809 16:16:37.616519 11027 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:37.611204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:41925 (local address 127.27.217.62:42329)
0809 16:16:37.611320 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:37.611323 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:37.611407 (+ 84us) server_negotiation.cc:407] Connection header received
0809 16:16:37.611434 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:37.611435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:37.611448 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:37.611506 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:37.611826 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.612621 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.613286 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.613608 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.613672 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:37.616381 (+ 2709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.1:41925: BlockingRecv error: recv got EOF from 127.27.217.1:41925 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":56,"threads_started":1}
Aug 09 16:16:37 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 16:16:37 dist-test-slave-nj21 krb5kdc[9275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.217.2@KRBTEST.COM for oryx/127.27.217.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 16:16:37.758910 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:37.754435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42329 (local address 127.27.217.2:50889)
0809 16:16:37.754553 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:37.754564 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:37.754624 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:37.754734 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:37.754734 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:37.754926 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:37.754979 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:37.754980 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.755767 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.755769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:37.756317 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:37.756320 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.756668 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.756669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:37.756729 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:37.757138 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:37.757142 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:37.758812 (+ 1670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.217.62:42329: Server oryx/127.27.217.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
W20260809 16:16:37.758967 11027 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:37.754538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:50889 (local address 127.27.217.62:42329)
0809 16:16:37.754583 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:37.754585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:37.754609 (+ 24us) server_negotiation.cc:407] Connection header received
0809 16:16:37.754668 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:37.754668 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:37.754679 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:37.754723 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:37.755029 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.755645 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.756399 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.756604 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.756659 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:37.758913 (+ 2254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.217.2:50889: BlockingRecv error: recv got EOF from 127.27.217.2:50889 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:16:37.819106 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 10258
I20260809 16:16:37.829861 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 10513
I20260809 16:16:37.835760 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 10724
I20260809 16:16:37.842324 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 10138
2026-08-09T16:16:37Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17565 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T16:16:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:37Z Disabled control of system clock
I20260809 16:16:37.870985 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45915
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:35323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:45915
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 16:16:37.950932 11033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:37.951120 11033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:37.951138 11033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:37.952250 11033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:37.952286 11033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:37.952296 11033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:37.952307 11033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:37.952317 11033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:37.953572 11033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:35323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:45915
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:37.953763 11033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:37.953990 11033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:37.958395 11042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:37.958416 11044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:37.958431 11041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:37.958611 11033 server_base.cc:1034] running on GCE node
I20260809 16:16:37.958904 11033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:37.959182 11033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:37.960314 11033 hybrid_clock.cc:648] HybridClock initialized: now 1786292197960300 us; error 28 us; skew 500 ppm
I20260809 16:16:37.961421 11033 webserver.cc:460] Webserver started at http://127.27.217.62:44171/ using document root <none> and password file <none>
I20260809 16:16:37.961624 11033 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:37.961666 11033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:37.961784 11033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:37.962779 11033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "6864befb49c6479db32a6d8b23e2e3a2"
format_stamp: "Formatted at 2026-08-09 16:16:37 on dist-test-slave-nj21"
server_key: "7c3267dc9e5fd96d253c55c8f1959f1e"
server_key_iv: "e942d1838fffc915cc85d1da8c7d6c7d"
server_key_version: "encryptionkey@0"
I20260809 16:16:37.963120 11033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "6864befb49c6479db32a6d8b23e2e3a2"
format_stamp: "Formatted at 2026-08-09 16:16:37 on dist-test-slave-nj21"
server_key: "7c3267dc9e5fd96d253c55c8f1959f1e"
server_key_iv: "e942d1838fffc915cc85d1da8c7d6c7d"
server_key_version: "encryptionkey@0"
I20260809 16:16:37.964408 11033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:37.965063 11054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:37.965197 11033 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:37.965282 11033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "6864befb49c6479db32a6d8b23e2e3a2"
format_stamp: "Formatted at 2026-08-09 16:16:37 on dist-test-slave-nj21"
server_key: "7c3267dc9e5fd96d253c55c8f1959f1e"
server_key_iv: "e942d1838fffc915cc85d1da8c7d6c7d"
server_key_version: "encryptionkey@0"
I20260809 16:16:37.965346 11033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:37.978245 11033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:37.978518 11033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:37.978641 11033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:37.982450 11033 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:45915
I20260809 16:16:37.982478 11132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:45915 every 8 connection(s)
I20260809 16:16:37.982777 11033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:37.983453 11133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:37.985037 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 11033
I20260809 16:16:37.985142 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:37.985338 28516 external_mini_cluster.cc:1428] Setting key 56184df6b475f3470f167fe2dbbfb534
I20260809 16:16:37.986371 11133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2: Bootstrap starting.
I20260809 16:16:37.986884 11133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:37.987116 11133 log.cc:824] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:37.987839 11133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2: No bootstrap required, opened a new log
I20260809 16:16:37.989332 11133 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6864befb49c6479db32a6d8b23e2e3a2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45915 } }
I20260809 16:16:37.989516 11133 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:37.989552 11133 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6864befb49c6479db32a6d8b23e2e3a2, State: Initialized, Role: FOLLOWER
I20260809 16:16:37.989672 11133 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6864befb49c6479db32a6d8b23e2e3a2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45915 } }
I20260809 16:16:37.989969 11133 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:37.990010 11133 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:37.990058 11133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:37.990567 11133 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6864befb49c6479db32a6d8b23e2e3a2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45915 } }
I20260809 16:16:37.990672 11133 leader_election.cc:302] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6864befb49c6479db32a6d8b23e2e3a2; no voters:
I20260809 16:16:37.990839 11133 leader_election.cc:288] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:37.990873 11141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:37.991074 11133 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:37.991397 11141 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [term 1 LEADER]: Becoming Leader. State: Replica: 6864befb49c6479db32a6d8b23e2e3a2, State: Running, Role: LEADER
I20260809 16:16:37.991497 11141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6864befb49c6479db32a6d8b23e2e3a2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45915 } }
I20260809 16:16:37.991884 11144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6864befb49c6479db32a6d8b23e2e3a2. Latest consensus state: current_term: 1 leader_uuid: "6864befb49c6479db32a6d8b23e2e3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6864befb49c6479db32a6d8b23e2e3a2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45915 } } }
I20260809 16:16:37.992048 11144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:37.992100 11139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:37.985837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47580 (local address 127.27.217.62:45915)
0809 16:16:37.987358 (+ 1521us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:37.987365 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:37.987388 (+ 23us) server_negotiation.cc:407] Connection header received
0809 16:16:37.987810 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:37.987816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:37.987874 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:37.988004 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:37.988211 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.989049 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.990115 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:37.990544 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:37.990631 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:37.991317 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:37.991321 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:37.991321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:37.991530 (+ 209us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:37.991575 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:37.991590 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:37.991652 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:37.991759 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 16:16:37.991872 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1466,"thread_start_us":64,"threads_started":1}
I20260809 16:16:37.992425 11142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6864befb49c6479db32a6d8b23e2e3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6864befb49c6479db32a6d8b23e2e3a2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45915 } } }
I20260809 16:16:37.992470 11157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:37.992595 11142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:37.993307 11157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:37.994886 11157 catalog_manager.cc:1347] Generated new cluster ID: 6e9beb3f36f94aae9840c97c0f3e276a
I20260809 16:16:37.994935 11157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:38.005738 11157 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:38.006247 11157 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:38.010030 11157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6864befb49c6479db32a6d8b23e2e3a2: Generated new TSK 0
I20260809 16:16:38.010181 11157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:16:38.015120 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45915
--builtin_ntp_servers=127.27.217.20:35323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 16:16:38.102728 11170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:38.102933 11170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:38.102954 11170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:38.104097 11170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:38.104136 11170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:38.104159 11170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:38.105444 11170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:35323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:38.105654 11170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:38.105932 11170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:38.111410 11177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.111421 11176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.111581 11170 server_base.cc:1034] running on GCE node
W20260809 16:16:38.111636 11181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.111896 11170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:38.112121 11170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:38.113272 11170 hybrid_clock.cc:648] HybridClock initialized: now 1786292198113254 us; error 35 us; skew 500 ppm
I20260809 16:16:38.114394 11170 webserver.cc:460] Webserver started at http://127.27.217.1:41743/ using document root <none> and password file <none>
I20260809 16:16:38.114606 11170 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:38.114648 11170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:38.114779 11170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:38.115859 11170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "a00c20a25423430a8a2e4feb984dd988"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "b8a0450b3867d0c16c2422484d669bfe"
server_key_iv: "eec4f7543a3e2a5e459300f7ab96d0f5"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.116179 11170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "a00c20a25423430a8a2e4feb984dd988"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "b8a0450b3867d0c16c2422484d669bfe"
server_key_iv: "eec4f7543a3e2a5e459300f7ab96d0f5"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.117388 11170 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:16:38.118067 11188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.118199 11170 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:38.118285 11170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "a00c20a25423430a8a2e4feb984dd988"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "b8a0450b3867d0c16c2422484d669bfe"
server_key_iv: "eec4f7543a3e2a5e459300f7ab96d0f5"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.118351 11170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:38.136916 11170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:38.137198 11170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:38.137331 11170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:38.137542 11170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:38.137864 11170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:38.137897 11170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.137918 11170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:38.137938 11170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.143577 11170 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:45211
I20260809 16:16:38.143625 11378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:45211 every 8 connection(s)
I20260809 16:16:38.143991 11170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:38.148897 11139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.144699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:43947 (local address 127.27.217.62:45915)
0809 16:16:38.144807 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.144808 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.144971 (+ 163us) server_negotiation.cc:407] Connection header received
0809 16:16:38.145472 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.145473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.145485 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.145547 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.146175 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.146685 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.147608 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.147826 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.147882 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:38.148660 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:38.148661 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:38.148662 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:38.148667 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:38.148683 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:38.148687 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:38.148738 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:38.148802 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 16:16:38.148835 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 16:16:38.149073 11381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.144660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45915 (local address 127.27.217.1:43947)
0809 16:16:38.144850 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:38.144891 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:38.145361 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:38.145597 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:38.145600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:38.145609 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:38.146085 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:38.146090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.146751 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.146751 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:38.147523 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:38.147525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.147896 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.147897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:38.148008 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:38.148508 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:38.148508 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:38.148537 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:38.148559 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:38.148738 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:38.148740 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:38.148742 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:16:38.148786 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:38.148875 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260809 16:16:38.149618 11379 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45915
I20260809 16:16:38.149706 11379 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:38.149910 11379 heartbeater.cc:511] Master 127.27.217.62:45915 requested a full tablet report, sending...
I20260809 16:16:38.150394 11081 ts_manager.cc:194] Registered new tserver with Master: a00c20a25423430a8a2e4feb984dd988 (127.27.217.1:45211)
I20260809 16:16:38.150970 11081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.1:43947
I20260809 16:16:38.151273 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 11170
I20260809 16:16:38.151353 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:38.151551 28516 external_mini_cluster.cc:1428] Setting key 928a6f21124dfaeb460e0862674cb1d4
I20260809 16:16:38.152478 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45915
--builtin_ntp_servers=127.27.217.20:35323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 16:16:38.235394 11382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:38.235592 11382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:38.235615 11382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:38.236792 11382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:38.236840 11382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:38.236868 11382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:38.238245 11382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:35323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:38.238468 11382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:38.238758 11382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:38.243384 11392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.243402 11389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.243491 11390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.243513 11382 server_base.cc:1034] running on GCE node
I20260809 16:16:38.243932 11382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:38.244166 11382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:38.245301 11382 hybrid_clock.cc:648] HybridClock initialized: now 1786292198245288 us; error 26 us; skew 500 ppm
I20260809 16:16:38.246425 11382 webserver.cc:460] Webserver started at http://127.27.217.2:41149/ using document root <none> and password file <none>
I20260809 16:16:38.246624 11382 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:38.246671 11382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:38.246795 11382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:38.247830 11382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "6c0659ea3f444bbba84efd071863983b"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "bfda932c0b08de8da2f6b359070ca6df"
server_key_iv: "e8f558205886ac8815a80b131e1078bf"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.248150 11382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "6c0659ea3f444bbba84efd071863983b"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "bfda932c0b08de8da2f6b359070ca6df"
server_key_iv: "e8f558205886ac8815a80b131e1078bf"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.249310 11382 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:38.249930 11400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.250077 11382 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:38.250155 11382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "6c0659ea3f444bbba84efd071863983b"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "bfda932c0b08de8da2f6b359070ca6df"
server_key_iv: "e8f558205886ac8815a80b131e1078bf"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.250217 11382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:38.272828 11382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:38.273124 11382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:38.273252 11382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:38.273461 11382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:38.273794 11382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:38.273830 11382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.273869 11382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:38.273893 11382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.279320 11382 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:40461
I20260809 16:16:38.279392 11576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:40461 every 8 connection(s)
I20260809 16:16:38.279690 11382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:16:38.284288 11139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.280352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:33331 (local address 127.27.217.62:45915)
0809 16:16:38.280409 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.280411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.280641 (+ 230us) server_negotiation.cc:407] Connection header received
0809 16:16:38.281105 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.281106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.281115 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.281171 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.281783 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.282265 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.283135 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.283310 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.283359 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:38.284104 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:38.284105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:38.284105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:38.284108 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:38.284118 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:38.284122 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:38.284156 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:38.284210 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 16:16:38.284229 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:16:38.284480 11580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.280335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45915 (local address 127.27.217.2:33331)
0809 16:16:38.280522 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:38.280562 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:38.281033 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:38.281222 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:38.281225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:38.281234 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:38.281724 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:38.281728 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.282323 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.282324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:38.283077 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:38.283079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.283366 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.283366 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:38.283465 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:38.283989 (+ 524us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:38.283990 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:38.284018 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:38.284040 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:38.284158 (+ 118us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:38.284160 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:38.284162 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:16:38.284205 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:16:38.284280 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260809 16:16:38.284929 11577 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45915
I20260809 16:16:38.285009 11577 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:38.285178 11577 heartbeater.cc:511] Master 127.27.217.62:45915 requested a full tablet report, sending...
I20260809 16:16:38.285501 11081 ts_manager.cc:194] Registered new tserver with Master: 6c0659ea3f444bbba84efd071863983b (127.27.217.2:40461)
I20260809 16:16:38.285861 11081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.2:33331
I20260809 16:16:38.288100 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 11382
I20260809 16:16:38.288170 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:38.288342 28516 external_mini_cluster.cc:1428] Setting key 95f0b9062122f4a788dc99732d268cf5
I20260809 16:16:38.289131 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45915
--builtin_ntp_servers=127.27.217.20:35323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 16:16:38.368232 11581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:38.368433 11581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:38.368461 11581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:38.369586 11581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:38.369623 11581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:38.369654 11581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:38.370926 11581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:35323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:38.371150 11581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:38.371415 11581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:38.376160 11590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.376202 11586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.376190 11588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.376310 11581 server_base.cc:1034] running on GCE node
I20260809 16:16:38.376609 11581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:38.376812 11581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:38.377969 11581 hybrid_clock.cc:648] HybridClock initialized: now 1786292198377951 us; error 27 us; skew 500 ppm
I20260809 16:16:38.379098 11581 webserver.cc:460] Webserver started at http://127.27.217.3:40825/ using document root <none> and password file <none>
I20260809 16:16:38.379304 11581 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:38.379361 11581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:38.379492 11581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:38.380537 11581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "f41e18a623904ae7b76bedd13407610e"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "564199767bb1b00850b4d7398a1c253a"
server_key_iv: "cca739d352cd0109b2bcc5cca974c532"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.380867 11581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "f41e18a623904ae7b76bedd13407610e"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "564199767bb1b00850b4d7398a1c253a"
server_key_iv: "cca739d352cd0109b2bcc5cca974c532"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.382043 11581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:38.382728 11601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.382869 11581 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:38.382951 11581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "f41e18a623904ae7b76bedd13407610e"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "564199767bb1b00850b4d7398a1c253a"
server_key_iv: "cca739d352cd0109b2bcc5cca974c532"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.383015 11581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:38.398602 11581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:38.398928 11581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:38.399065 11581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:38.399282 11581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:38.399605 11581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:38.399641 11581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.399739 11581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:38.399762 11581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.405224 11581 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:44289
I20260809 16:16:38.405282 11759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:44289 every 8 connection(s)
I20260809 16:16:38.405580 11581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:38.410418 11139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.406262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:53749 (local address 127.27.217.62:45915)
0809 16:16:38.406318 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.406319 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.406545 (+ 226us) server_negotiation.cc:407] Connection header received
0809 16:16:38.407019 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.407020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.407028 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.407089 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.407689 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.408171 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.409087 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.409283 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.409350 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:38.410150 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:38.410151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:38.410152 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:38.410157 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:38.410172 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:38.410176 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:38.410219 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:38.410294 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 16:16:38.410324 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 16:16:38.410598 11763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.406240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45915 (local address 127.27.217.3:53749)
0809 16:16:38.406427 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:38.406468 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:38.406944 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:38.407141 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:38.407144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:38.407153 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:38.407609 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:38.407613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.408234 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.408234 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:38.409009 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:38.409011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:38.409423 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:38.409424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:38.409552 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:38.410007 (+ 455us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:38.410008 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:38.410036 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:38.410059 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:38.410225 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:38.410230 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:38.410234 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:38.410292 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 16:16:38.410410 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260809 16:16:38.411033 11760 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45915
I20260809 16:16:38.411124 11760 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:38.411299 11760 heartbeater.cc:511] Master 127.27.217.62:45915 requested a full tablet report, sending...
I20260809 16:16:38.411625 11081 ts_manager.cc:194] Registered new tserver with Master: f41e18a623904ae7b76bedd13407610e (127.27.217.3:44289)
I20260809 16:16:38.412005 11081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.3:53749
I20260809 16:16:38.414256 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 11581
I20260809 16:16:38.414343 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:38.414520 28516 external_mini_cluster.cc:1428] Setting key 7c6bb35c519b9a227a9efd13a0360f10
I20260809 16:16:38.415349 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 16:16:38.417037 11139 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:38.416640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.27.217.62:45915)
0809 16:16:38.416701 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.416703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.416777 (+ 74us) server_negotiation.cc:407] Connection header received
0809 16:16:38.416815 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.416815 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.416822 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.416863 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.416977 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47596: BlockingRecv error: recv got EOF from 127.0.0.1:47596 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 16:16:38.417085 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 11170
I20260809 16:16:38.436220 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 11382
I20260809 16:16:38.449225 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 11581
I20260809 16:16:38.458014 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 11033
2026-08-09T16:16:38Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (616 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T16:16:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:38Z Disabled control of system clock
I20260809 16:16:38.487118 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:42747
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:42747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 16:16:38.565310 11774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:38.565512 11774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:38.565532 11774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:38.566619 11774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:38.566663 11774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:38.566673 11774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:38.566685 11774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:38.566696 11774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:38.568038 11774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:42747
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:42747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:38.568259 11774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:38.568519 11774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:38.573042 11785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.573129 11782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.573046 11788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.573262 11774 server_base.cc:1034] running on GCE node
I20260809 16:16:38.573515 11774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:38.573783 11774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:38.574960 11774 hybrid_clock.cc:648] HybridClock initialized: now 1786292198574944 us; error 31 us; skew 500 ppm
I20260809 16:16:38.576159 11774 webserver.cc:460] Webserver started at http://127.27.217.62:37711/ using document root <none> and password file <none>
I20260809 16:16:38.576395 11774 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:38.576444 11774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:38.576570 11774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:38.577576 11774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "b13c33ac5e1c41a59c8d2282f5f9be36"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "44021902b040ac5cd99ea952db26ddfc"
server_key_iv: "373d786cb1091bac4fae2edf738ac609"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.577901 11774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "b13c33ac5e1c41a59c8d2282f5f9be36"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "44021902b040ac5cd99ea952db26ddfc"
server_key_iv: "373d786cb1091bac4fae2edf738ac609"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.579069 11774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:38.579743 11796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.579883 11774 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:38.579969 11774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "b13c33ac5e1c41a59c8d2282f5f9be36"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "44021902b040ac5cd99ea952db26ddfc"
server_key_iv: "373d786cb1091bac4fae2edf738ac609"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.580034 11774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:38.583109 11774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:38.583348 11774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:38.583464 11774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:38.587129 11774 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:42747
I20260809 16:16:38.587157 11868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:42747 every 8 connection(s)
I20260809 16:16:38.587453 11774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:38.588073 11869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:38.590664 11869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36: Bootstrap starting.
I20260809 16:16:38.591099 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 11774
I20260809 16:16:38.591194 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:38.591312 11869 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:38.591403 28516 external_mini_cluster.cc:1428] Setting key 6e2833289a6a8676f3b48378f10cf7d6
I20260809 16:16:38.591631 11869 log.cc:824] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:38.592300 11869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36: No bootstrap required, opened a new log
I20260809 16:16:38.593705 11875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.591916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57492 (local address 127.27.217.62:42747)
0809 16:16:38.592108 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.592116 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.592141 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:16:38.592558 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.592565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.592603 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.592723 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.593336 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:38.593339 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:38.593340 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:38.593344 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:38.593387 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:38.593397 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:38.593469 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:38.593502 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 16:16:38.593556 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260809 16:16:38.593871 11869 raft_consensus.cc:348] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13c33ac5e1c41a59c8d2282f5f9be36" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42747 } }
I20260809 16:16:38.594029 11869 raft_consensus.cc:374] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:38.594077 11869 raft_consensus.cc:729] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13c33ac5e1c41a59c8d2282f5f9be36, State: Initialized, Role: FOLLOWER
I20260809 16:16:38.594197 11869 consensus_queue.cc:260] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13c33ac5e1c41a59c8d2282f5f9be36" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42747 } }
I20260809 16:16:38.594276 11869 raft_consensus.cc:388] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:38.594316 11869 raft_consensus.cc:482] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:38.594359 11869 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:38.595108 11869 raft_consensus.cc:504] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13c33ac5e1c41a59c8d2282f5f9be36" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42747 } }
I20260809 16:16:38.595193 11869 leader_election.cc:302] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b13c33ac5e1c41a59c8d2282f5f9be36; no voters:
I20260809 16:16:38.595307 11869 leader_election.cc:288] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:38.595350 11877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:38.595496 11877 raft_consensus.cc:686] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [term 1 LEADER]: Becoming Leader. State: Replica: b13c33ac5e1c41a59c8d2282f5f9be36, State: Running, Role: LEADER
I20260809 16:16:38.595546 11869 sys_catalog.cc:564] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:38.595606 11877 consensus_queue.cc:237] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13c33ac5e1c41a59c8d2282f5f9be36" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42747 } }
I20260809 16:16:38.595963 11878 sys_catalog.cc:455] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b13c33ac5e1c41a59c8d2282f5f9be36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13c33ac5e1c41a59c8d2282f5f9be36" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42747 } } }
I20260809 16:16:38.596081 11878 sys_catalog.cc:458] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:38.595965 11881 sys_catalog.cc:455] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b13c33ac5e1c41a59c8d2282f5f9be36. Latest consensus state: current_term: 1 leader_uuid: "b13c33ac5e1c41a59c8d2282f5f9be36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13c33ac5e1c41a59c8d2282f5f9be36" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42747 } } }
I20260809 16:16:38.596205 11881 sys_catalog.cc:458] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:38.596514 11891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:38.596943 11891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:38.598277 11891 catalog_manager.cc:1347] Generated new cluster ID: 436f594a24a54df482906e60a7f90642
I20260809 16:16:38.598328 11891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:38.621593 11891 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:38.621762 11891 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:38.628050 11891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b13c33ac5e1c41a59c8d2282f5f9be36: Generated new TSK 0
I20260809 16:16:38.628216 11891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:16:38.634137 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42747
--builtin_ntp_servers=127.27.217.20:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 16:16:38.714205 11907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:38.714406 11907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:38.714437 11907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:38.715569 11907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:38.715606 11907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:38.715639 11907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:38.717000 11907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:38.717222 11907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:38.717491 11907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:38.722045 11918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.722045 11916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.722047 11915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.722369 11907 server_base.cc:1034] running on GCE node
I20260809 16:16:38.722569 11907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:38.722774 11907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:38.723903 11907 hybrid_clock.cc:648] HybridClock initialized: now 1786292198723892 us; error 37 us; skew 500 ppm
I20260809 16:16:38.725067 11907 webserver.cc:460] Webserver started at http://127.27.217.1:33755/ using document root <none> and password file <none>
I20260809 16:16:38.725293 11907 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:38.725353 11907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:38.725484 11907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:38.726496 11907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "17382cdacdfd42dfb2818510545ed371"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "2f3d5fb09955c89eeab06e9e7ea22d63"
server_key_iv: "dae4960e1cb61c0b340bc008d7ea0950"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.726820 11907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "17382cdacdfd42dfb2818510545ed371"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "2f3d5fb09955c89eeab06e9e7ea22d63"
server_key_iv: "dae4960e1cb61c0b340bc008d7ea0950"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.728024 11907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:38.728672 11931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.728818 11907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:38.728901 11907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "17382cdacdfd42dfb2818510545ed371"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "2f3d5fb09955c89eeab06e9e7ea22d63"
server_key_iv: "dae4960e1cb61c0b340bc008d7ea0950"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.728956 11907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:38.732112 11907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:38.732349 11907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:38.732463 11907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:38.732640 11907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:38.732910 11907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:38.732942 11907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.732968 11907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:38.732992 11907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.738379 11907 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:33771
I20260809 16:16:38.738436 12105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:33771 every 8 connection(s)
I20260809 16:16:38.738693 11907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:16:38.739518 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 11907
I20260809 16:16:38.739604 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:38.739801 28516 external_mini_cluster.cc:1428] Setting key 0517759ab37fe2b4c09a44b454880749
I20260809 16:16:38.740759 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42747
--builtin_ntp_servers=127.27.217.20:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 16:16:38.741472 11875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.739281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:35497 (local address 127.27.217.62:42747)
0809 16:16:38.739342 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.739344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.739532 (+ 188us) server_negotiation.cc:407] Connection header received
0809 16:16:38.740068 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.740069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.740076 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.740127 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.741253 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:38.741255 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:38.741255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:38.741259 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:38.741277 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:38.741282 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:38.741344 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:38.741390 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 16:16:38.741404 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:16:38.741616 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.739258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42747 (local address 127.27.217.1:35497)
0809 16:16:38.739430 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:38.739460 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:38.739944 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:38.740186 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:38.740189 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:38.740198 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:38.741116 (+ 918us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:38.741117 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:38.741144 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:38.741169 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:38.741344 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:38.741346 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:38.741348 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:16:38.741395 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 16:16:38.741439 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":93,"threads_started":1}
I20260809 16:16:38.742641 12106 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42747
I20260809 16:16:38.742725 12106 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:38.742864 12106 heartbeater.cc:511] Master 127.27.217.62:42747 requested a full tablet report, sending...
I20260809 16:16:38.743382 11818 ts_manager.cc:194] Registered new tserver with Master: 17382cdacdfd42dfb2818510545ed371 (127.27.217.1:33771)
W20260809 16:16:38.820228 12110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:38.820425 12110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:38.820454 12110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:38.821583 12110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:38.821620 12110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:38.821653 12110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:38.822974 12110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:38.823196 12110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:38.823463 12110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:38.828008 12118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.828073 12119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.828009 12121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.828222 12110 server_base.cc:1034] running on GCE node
I20260809 16:16:38.828455 12110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:38.828663 12110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:38.829797 12110 hybrid_clock.cc:648] HybridClock initialized: now 1786292198829784 us; error 28 us; skew 500 ppm
I20260809 16:16:38.830928 12110 webserver.cc:460] Webserver started at http://127.27.217.2:44103/ using document root <none> and password file <none>
I20260809 16:16:38.831138 12110 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:38.831187 12110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:38.831303 12110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:38.832342 12110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "280eb7299bfb47678d2e8d76baa339d6"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "4db141ba6f857c9e86a772330a722d92"
server_key_iv: "9468f01ffe57b89c97815f436390df1e"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.832654 12110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "280eb7299bfb47678d2e8d76baa339d6"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "4db141ba6f857c9e86a772330a722d92"
server_key_iv: "9468f01ffe57b89c97815f436390df1e"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.833823 12110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:38.834475 12132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.834616 12110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:38.834695 12110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "280eb7299bfb47678d2e8d76baa339d6"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "4db141ba6f857c9e86a772330a722d92"
server_key_iv: "9468f01ffe57b89c97815f436390df1e"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.834753 12110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:38.837924 12110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:38.838166 12110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:38.838279 12110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:38.838456 12110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:38.838755 12110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:38.838805 12110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.838831 12110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:38.838856 12110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.844311 12110 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:34331
I20260809 16:16:38.844374 12307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:34331 every 8 connection(s)
I20260809 16:16:38.844633 12110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:16:38.845709 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 12110
I20260809 16:16:38.845794 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:38.845968 28516 external_mini_cluster.cc:1428] Setting key 679b6b9045af56b4ac8d5819205807b8
I20260809 16:16:38.846814 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42747
--builtin_ntp_servers=127.27.217.20:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 16:16:38.847267 11875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.845223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:51787 (local address 127.27.217.62:42747)
0809 16:16:38.845280 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.845282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.845465 (+ 183us) server_negotiation.cc:407] Connection header received
0809 16:16:38.845927 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.845929 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.845936 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.845987 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.847034 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:38.847035 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:38.847036 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:38.847041 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:38.847057 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:38.847061 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:38.847109 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:38.847183 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 16:16:38.847197 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:16:38.847445 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.845202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42747 (local address 127.27.217.2:51787)
0809 16:16:38.845361 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:38.845391 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:38.845821 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:38.846050 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:38.846054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:38.846062 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:38.846897 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:38.846897 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:38.846923 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:38.846949 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:38.847115 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:38.847120 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:38.847123 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:38.847189 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 16:16:38.847247 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
I20260809 16:16:38.847944 12308 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42747
I20260809 16:16:38.848014 12308 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:38.848140 12308 heartbeater.cc:511] Master 127.27.217.62:42747 requested a full tablet report, sending...
I20260809 16:16:38.848462 11818 ts_manager.cc:194] Registered new tserver with Master: 280eb7299bfb47678d2e8d76baa339d6 (127.27.217.2:34331)
W20260809 16:16:38.926795 12312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:38.926982 12312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:38.927002 12312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:38.928128 12312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:38.928166 12312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:38.928190 12312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:38.929498 12312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:38.929735 12312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:38.929996 12312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:38.934664 12318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:38.934677 12319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.934789 12312 server_base.cc:1034] running on GCE node
W20260809 16:16:38.934670 12322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:38.935065 12312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:38.935282 12312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:38.936405 12312 hybrid_clock.cc:648] HybridClock initialized: now 1786292198936393 us; error 25 us; skew 500 ppm
I20260809 16:16:38.937563 12312 webserver.cc:460] Webserver started at http://127.27.217.3:45891/ using document root <none> and password file <none>
I20260809 16:16:38.937767 12312 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:38.937812 12312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:38.937947 12312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:38.938979 12312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "cb1d45b8b5bb44af9c21ba6cdbc07031"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "3a8c726b8386b4855a5f7db852808306"
server_key_iv: "c35b44ec30b88bf513333ad96b68c1a1"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.939297 12312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "cb1d45b8b5bb44af9c21ba6cdbc07031"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "3a8c726b8386b4855a5f7db852808306"
server_key_iv: "c35b44ec30b88bf513333ad96b68c1a1"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.940538 12312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:16:38.941164 12332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.941322 12312 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:38.941406 12312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "cb1d45b8b5bb44af9c21ba6cdbc07031"
format_stamp: "Formatted at 2026-08-09 16:16:38 on dist-test-slave-nj21"
server_key: "3a8c726b8386b4855a5f7db852808306"
server_key_iv: "c35b44ec30b88bf513333ad96b68c1a1"
server_key_version: "encryptionkey@0"
I20260809 16:16:38.941464 12312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:38.944593 12312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:38.944815 12312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:38.944944 12312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:38.945128 12312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:38.945396 12312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:38.945427 12312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.945452 12312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:38.945475 12312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:38.950699 12312 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:38027
I20260809 16:16:38.950757 12516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:38027 every 8 connection(s)
I20260809 16:16:38.951013 12312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:38.952054 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 12312
I20260809 16:16:38.952123 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:38.952284 28516 external_mini_cluster.cc:1428] Setting key 10a65841a9ac9eaf7075579278aaa92c
I20260809 16:16:38.953775 11875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.951644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:47231 (local address 127.27.217.62:42747)
0809 16:16:38.951731 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.951733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.951910 (+ 177us) server_negotiation.cc:407] Connection header received
0809 16:16:38.952404 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.952405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.952412 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.952464 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.953551 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:38.953553 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:38.953553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:16:38.953557 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:38.953573 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:16:38.953577 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:38.953625 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:38.953692 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 16:16:38.953706 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 16:16:38.953949 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:38.951608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42747 (local address 127.27.217.3:47231)
0809 16:16:38.951800 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:38.951832 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:38.952304 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:38.952528 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:38.952532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:38.952541 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:38.953417 (+ 876us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:16:38.953417 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:38.953444 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:16:38.953469 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:38.953629 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:38.953634 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:38.953637 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:38.953703 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 16:16:38.953761 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260809 16:16:38.954319 12518 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42747
I20260809 16:16:38.954393 12518 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:38.954522 12518 heartbeater.cc:511] Master 127.27.217.62:42747 requested a full tablet report, sending...
I20260809 16:16:38.954844 11818 ts_manager.cc:194] Registered new tserver with Master: cb1d45b8b5bb44af9c21ba6cdbc07031 (127.27.217.3:38027)
I20260809 16:16:38.963698 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 16:16:38.965381 11875 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:16:38.964966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.27.217.62:42747)
0809 16:16:38.965026 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:38.965027 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:38.965100 (+ 73us) server_negotiation.cc:407] Connection header received
0809 16:16:38.965160 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:38.965161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:38.965166 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:38.965209 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:38.965322 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57500: BlockingRecv error: recv got EOF from 127.0.0.1:57500 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 16:16:38.965448 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 11907
I20260809 16:16:38.977460 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 12110
I20260809 16:16:38.985608 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 12312
I20260809 16:16:38.999315 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 11774
2026-08-09T16:16:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (541 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:39 dist-test-slave-nj21 krb5kdc[12531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:39 dist-test-slave-nj21 krb5kdc[12531](info): set up 2 sockets
Aug 09 16:16:39 dist-test-slave-nj21 krb5kdc[12531](info): commencing operation
krb5kdc: starting...
W20260809 16:16:40.147269 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:16:40.258931 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35177
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:42321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:35177
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:40.337148 12550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:40.337354 12550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:40.337386 12550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:40.338505 12550 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:16:40.338544 12550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:40.338562 12550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:40.338579 12550 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:16:40.338593 12550 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:16:40.340065 12550 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:42321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:35177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:40.340312 12550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:40.340512 12550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:40.345135 12558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:40.345227 12560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:40.345217 12556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:40.345219 12550 server_base.cc:1034] running on GCE node
I20260809 16:16:40.345537 12550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:40.345801 12550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:40.346961 12550 hybrid_clock.cc:648] HybridClock initialized: now 1786292200346949 us; error 28 us; skew 500 ppm
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:40.349277 12550 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:16:40.349716 12550 webserver.cc:460] Webserver started at http://127.27.217.62:35243/ using document root <none> and password file <none>
I20260809 16:16:40.349921 12550 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:40.349968 12550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:40.350098 12550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:40.351151 12550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "dce463cc667447569f50a1af3c795d78"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "6fec2cc90158d3f108fbc3c0b9f5b5eb"
server_key_iv: "d530581b4bc5055698bd3d8c5b56a536"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.351511 12550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "dce463cc667447569f50a1af3c795d78"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "6fec2cc90158d3f108fbc3c0b9f5b5eb"
server_key_iv: "d530581b4bc5055698bd3d8c5b56a536"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.352965 12550 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:16:40.353679 12575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.353827 12550 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:40.353919 12550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "dce463cc667447569f50a1af3c795d78"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "6fec2cc90158d3f108fbc3c0b9f5b5eb"
server_key_iv: "d530581b4bc5055698bd3d8c5b56a536"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.353984 12550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:40.365773 12550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:40.367416 12550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:40.367545 12550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:40.371441 12550 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:35177
I20260809 16:16:40.371474 12667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:35177 every 8 connection(s)
I20260809 16:16:40.371886 12550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:16:40.372828 12669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:40.373108 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 12550
I20260809 16:16:40.373214 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:16:40.373404 28516 external_mini_cluster.cc:1428] Setting key 45c606e32b72f9db22d1e9ea93df9fc1
I20260809 16:16:40.375710 12669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78: Bootstrap starting.
I20260809 16:16:40.376305 12669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:40.376556 12669 log.cc:824] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:40.377166 12669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78: No bootstrap required, opened a new log
I20260809 16:16:40.378988 12669 raft_consensus.cc:348] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce463cc667447569f50a1af3c795d78" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35177 } }
I20260809 16:16:40.379149 12669 raft_consensus.cc:374] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:40.379189 12669 raft_consensus.cc:729] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dce463cc667447569f50a1af3c795d78, State: Initialized, Role: FOLLOWER
I20260809 16:16:40.379324 12669 consensus_queue.cc:260] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce463cc667447569f50a1af3c795d78" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35177 } }
I20260809 16:16:40.379424 12669 raft_consensus.cc:388] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:16:40.379457 12669 raft_consensus.cc:482] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:16:40.379506 12669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:40.380079 12669 raft_consensus.cc:504] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce463cc667447569f50a1af3c795d78" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35177 } }
I20260809 16:16:40.380177 12669 leader_election.cc:302] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dce463cc667447569f50a1af3c795d78; no voters:
I20260809 16:16:40.380330 12669 leader_election.cc:288] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:16:40.380375 12675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:40.380530 12675 raft_consensus.cc:686] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [term 1 LEADER]: Becoming Leader. State: Replica: dce463cc667447569f50a1af3c795d78, State: Running, Role: LEADER
I20260809 16:16:40.380597 12669 sys_catalog.cc:564] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:16:40.380638 12675 consensus_queue.cc:237] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce463cc667447569f50a1af3c795d78" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35177 } }
I20260809 16:16:40.381000 12678 sys_catalog.cc:455] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dce463cc667447569f50a1af3c795d78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce463cc667447569f50a1af3c795d78" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35177 } } }
I20260809 16:16:40.381537 12679 sys_catalog.cc:455] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dce463cc667447569f50a1af3c795d78. Latest consensus state: current_term: 1 leader_uuid: "dce463cc667447569f50a1af3c795d78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce463cc667447569f50a1af3c795d78" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35177 } } }
I20260809 16:16:40.381785 12679 sys_catalog.cc:458] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [sys.catalog]: This master's current role is: LEADER
W20260809 16:16:40.382325 12700 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:16:40.382369 12700 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:16:40.382411 12702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:16:40.382547 12702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:16:40.381628 12678 sys_catalog.cc:458] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78 [sys.catalog]: This master's current role is: LEADER
I20260809 16:16:40.384016 12702 catalog_manager.cc:1347] Generated new cluster ID: 2ee2802bce914821b80e66eff3d8950e
I20260809 16:16:40.384063 12702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:16:40.384645 12673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.373896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53474 (local address 127.27.217.62:35177)
0809 16:16:40.374062 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:40.374070 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:40.374100 (+ 30us) server_negotiation.cc:407] Connection header received
0809 16:16:40.374506 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:40.374511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:40.374555 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:40.374666 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:40.375434 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.376393 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.377152 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.377609 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.377704 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.380175 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:40.380180 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:40.380180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:40.380192 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:40.382797 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.383180 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.383184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.383184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.383266 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.383478 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.383479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.383479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.383771 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:40.383915 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:40.384309 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 16:16:40.384449 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260809 16:16:40.394572 12702 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:16:40.395262 12702 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:16:40.403230 12702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78: Generated new TSK 0
I20260809 16:16:40.403411 12702 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:16:40.436590 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35177
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:42321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:40.552071 12707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:40.552327 12707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:40.552361 12707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:40.553829 12707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:40.553876 12707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:40.553902 12707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:16:40.555266 12707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:42321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:40.555441 12707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:40.555615 12707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:40.560284 12716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:40.560328 12720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:40.560328 12718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:40.560485 12707 server_base.cc:1034] running on GCE node
I20260809 16:16:40.560734 12707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:40.560945 12707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:40.562076 12707 hybrid_clock.cc:648] HybridClock initialized: now 1786292200562057 us; error 33 us; skew 500 ppm
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:40.564587 12707 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:16:40.565030 12707 webserver.cc:460] Webserver started at http://127.27.217.1:33957/ using document root <none> and password file <none>
I20260809 16:16:40.565229 12707 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:40.565280 12707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:40.565409 12707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:40.566408 12707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "ccd6335c74a945b8a65d155a9cb0616a"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "0db67d79a3626819c5f8ee1eea1b0693"
server_key_iv: "65fb88f07f2faa5a9d2b66a699f1e078"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.566764 12707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "ccd6335c74a945b8a65d155a9cb0616a"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "0db67d79a3626819c5f8ee1eea1b0693"
server_key_iv: "65fb88f07f2faa5a9d2b66a699f1e078"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.568125 12707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:16:40.568831 12729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.568990 12707 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:16:40.569082 12707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "ccd6335c74a945b8a65d155a9cb0616a"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "0db67d79a3626819c5f8ee1eea1b0693"
server_key_iv: "65fb88f07f2faa5a9d2b66a699f1e078"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.569144 12707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:40.597885 12707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:40.600003 12707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:40.600116 12707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:40.600317 12707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:40.600577 12707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:40.600607 12707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.600628 12707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:40.600642 12707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.605974 12707 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:44945
I20260809 16:16:40.606022 12919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:44945 every 8 connection(s)
I20260809 16:16:40.606321 12707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:40.612218 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 12707
I20260809 16:16:40.612299 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:16:40.612526 28516 external_mini_cluster.cc:1428] Setting key 279c575389484233efd2c434c0312cb9
I20260809 16:16:40.615105 12673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.606968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:41953 (local address 127.27.217.62:35177)
0809 16:16:40.607051 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:40.607053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:40.607187 (+ 134us) server_negotiation.cc:407] Connection header received
0809 16:16:40.607660 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:40.607661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:40.607691 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:40.607741 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:40.608626 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.609128 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.610074 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.610266 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.610310 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.612375 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:40.612377 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:40.612377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:40.612385 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:40.613878 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.614226 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.614227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.614227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.614290 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.614514 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.614514 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.614515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.614637 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:40.614700 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:40.614964 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 16:16:40.615041 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 16:16:40.615319 12925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.606935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35177 (local address 127.27.217.1:41953)
0809 16:16:40.607075 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:40.607110 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:40.607588 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:40.607803 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:40.607807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:40.608367 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:40.608557 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.608561 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.609198 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.609199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.610013 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.610015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.610357 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.610358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.610470 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.610911 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:40.610919 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:40.612278 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:40.613957 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:40.613963 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:40.613965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:40.614163 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:40.614358 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:40.614359 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:40.614359 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:40.614457 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:40.614689 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:40.614691 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:40.614826 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 16:16:40.614938 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 16:16:40.615099 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":80,"threads_started":1}
I20260809 16:16:40.615741 12921 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35177
I20260809 16:16:40.615841 12921 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:40.616006 12921 heartbeater.cc:511] Master 127.27.217.62:35177 requested a full tablet report, sending...
I20260809 16:16:40.616490 12607 ts_manager.cc:194] Registered new tserver with Master: ccd6335c74a945b8a65d155a9cb0616a (127.27.217.1:44945)
I20260809 16:16:40.617063 12607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:41953
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:16:40.636107 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35177
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:42321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:40.714952 12930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:40.715159 12930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:40.715189 12930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:40.716329 12930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:40.716372 12930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:40.716404 12930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:16:40.717785 12930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:42321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:40.718007 12930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:40.718215 12930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:16:40.722828 12930 server_base.cc:1034] running on GCE node
W20260809 16:16:40.722779 12939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:40.722790 12938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:40.722769 12943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:40.723240 12930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:40.723474 12930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:40.724602 12930 hybrid_clock.cc:648] HybridClock initialized: now 1786292200724590 us; error 27 us; skew 500 ppm
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:40.726918 12930 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:16:40.727275 12930 webserver.cc:460] Webserver started at http://127.27.217.2:45093/ using document root <none> and password file <none>
I20260809 16:16:40.727439 12930 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:40.727478 12930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:40.727566 12930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:40.728523 12930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "e0e6fbf1e4f7538987ef69b895e8729f"
server_key_iv: "3214ab7ed7cf7c0e7c5790e78c0ac691"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.728801 12930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "e0e6fbf1e4f7538987ef69b895e8729f"
server_key_iv: "3214ab7ed7cf7c0e7c5790e78c0ac691"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.729969 12930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:16:40.730580 12953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.730720 12930 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:16:40.730791 12930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "e0e6fbf1e4f7538987ef69b895e8729f"
server_key_iv: "3214ab7ed7cf7c0e7c5790e78c0ac691"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.730867 12930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:40.750584 12930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:40.752628 12930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:40.752759 12930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:40.752983 12930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:40.753266 12930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:40.753299 12930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.753319 12930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:40.753331 12930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.758991 12930 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:36843
I20260809 16:16:40.759050 13129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:36843 every 8 connection(s)
I20260809 16:16:40.759321 12930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:16:40.760274 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 12930
I20260809 16:16:40.760361 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:16:40.760541 28516 external_mini_cluster.cc:1428] Setting key caccd1dbcedd79a3adc54392bfc258b5
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:40.768260 12673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.759957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45195 (local address 127.27.217.62:35177)
0809 16:16:40.760011 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:40.760013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:40.760206 (+ 193us) server_negotiation.cc:407] Connection header received
0809 16:16:40.760740 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:40.760742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:40.760755 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:40.760805 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:40.761699 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.762180 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.763436 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.763626 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.763713 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.765805 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:40.765807 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:40.765807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:40.765815 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:40.767031 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.767381 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.767382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.767383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.767437 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.767647 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.767648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.767648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.767785 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:40.767842 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:40.768093 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 16:16:40.768172 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 16:16:40.768416 13133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.759923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35177 (local address 127.27.217.2:45195)
0809 16:16:40.760074 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:40.760115 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:40.760638 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:40.760882 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:40.760886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:40.761428 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:40.761605 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.761610 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.762259 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.762260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.763353 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.763356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.763719 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.763720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.763832 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.764231 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:40.764240 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:40.765722 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:40.767105 (+ 1383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:40.767111 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:40.767113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:40.767316 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:40.767490 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:40.767491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:40.767491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:40.767593 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:40.767848 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:40.767854 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:40.767978 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 16:16:40.768065 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 16:16:40.768215 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260809 16:16:40.769014 13130 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35177
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
I20260809 16:16:40.769098 13130 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:40.769256 13130 heartbeater.cc:511] Master 127.27.217.62:35177 requested a full tablet report, sending...
I20260809 16:16:40.769616 12607 ts_manager.cc:194] Registered new tserver with Master: 0d380d6ca2f54aa893a43b6dd6ee6d0a (127.27.217.2:36843)
I20260809 16:16:40.769984 12607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:45195
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:16:40.785544 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35177
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:42321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:16:40.863771 13138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:16:40.863947 13138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:16:40.863968 13138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:16:40.865073 13138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:16:40.865114 13138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:16:40.865142 13138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:16:40.866536 13138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:42321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:16:40.866745 13138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:16:40.866942 13138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:16:40.871573 13150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:40.871697 13146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:16:40.871713 13147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:16:40.871835 13138 server_base.cc:1034] running on GCE node
I20260809 16:16:40.872045 13138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:16:40.872251 13138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:16:40.873386 13138 hybrid_clock.cc:648] HybridClock initialized: now 1786292200873370 us; error 27 us; skew 500 ppm
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:16:40.875636 13138 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:16:40.876055 13138 webserver.cc:460] Webserver started at http://127.27.217.3:34895/ using document root <none> and password file <none>
I20260809 16:16:40.876259 13138 fs_manager.cc:359] Metadata directory not provided
I20260809 16:16:40.876309 13138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:16:40.876432 13138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:16:40.877386 13138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "c992b194942b4179bec3788c3e96e134"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "224d2e4578d6d674c487bb9e85d13690"
server_key_iv: "594c941c808e61de1d2ae682cfedca7a"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.877707 13138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "c992b194942b4179bec3788c3e96e134"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "224d2e4578d6d674c487bb9e85d13690"
server_key_iv: "594c941c808e61de1d2ae682cfedca7a"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.878877 13138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:16:40.879525 13160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.879686 13138 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.879766 13138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "c992b194942b4179bec3788c3e96e134"
format_stamp: "Formatted at 2026-08-09 16:16:40 on dist-test-slave-nj21"
server_key: "224d2e4578d6d674c487bb9e85d13690"
server_key_iv: "594c941c808e61de1d2ae682cfedca7a"
server_key_version: "encryptionkey@0"
I20260809 16:16:40.879832 13138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:16:40.896678 13138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:16:40.898528 13138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:16:40.898661 13138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:16:40.898885 13138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:16:40.899168 13138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:16:40.899200 13138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.899227 13138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:16:40.899251 13138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:16:40.904786 13138 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:40761
I20260809 16:16:40.904824 13327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:40761 every 8 connection(s)
I20260809 16:16:40.905115 13138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:16:40.909937 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 13138
I20260809 16:16:40.910024 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:16:40.910213 28516 external_mini_cluster.cc:1428] Setting key 0867046f52fcfc5eeead91b4affb1cba
Aug 09 16:16:40 dist-test-slave-nj21 krb5kdc[12531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:16:40.913384 12673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.905752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:42315 (local address 127.27.217.62:35177)
0809 16:16:40.905798 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:40.905800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:40.905983 (+ 183us) server_negotiation.cc:407] Connection header received
0809 16:16:40.906478 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:40.906480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:40.906492 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:40.906542 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:40.907421 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.907952 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.908879 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.909066 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.909122 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.911344 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:40.911345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:40.911346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:40.911353 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:40.912419 (+ 1066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.912742 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.912743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.912743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.912785 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.912936 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.912937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.912937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.913027 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:40.913071 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:40.913259 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 16:16:40.913318 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 16:16:40.913558 13331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.905718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35177 (local address 127.27.217.3:42315)
0809 16:16:40.905878 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:40.905909 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:40.906389 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:40.906608 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:40.906612 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:40.907149 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:16:40.907329 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.907334 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.908039 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.908040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.908800 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.908803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.909133 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.909134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.909247 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.909675 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:16:40.909684 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:16:40.911259 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:16:40.912481 (+ 1222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:40.912487 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:40.912488 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:40.912684 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:40.912820 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:16:40.912820 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:16:40.912820 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:16:40.912899 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:16:40.913069 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:16:40.913072 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:16:40.913173 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 16:16:40.913244 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:16:40.913362 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260809 16:16:40.913990 13329 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35177
I20260809 16:16:40.914072 13329 heartbeater.cc:464] Registering TS with master...
I20260809 16:16:40.914208 13329 heartbeater.cc:511] Master 127.27.217.62:35177 requested a full tablet report, sending...
I20260809 16:16:40.914521 12607 ts_manager.cc:194] Registered new tserver with Master: c992b194942b4179bec3788c3e96e134 (127.27.217.3:40761)
I20260809 16:16:40.914844 12607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:42315
I20260809 16:16:40.921641 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:16:40.927489 12673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.922777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53476 (local address 127.27.217.62:35177)
0809 16:16:40.922835 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:40.922837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:40.922918 (+ 81us) server_negotiation.cc:407] Connection header received
0809 16:16:40.922956 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:40.922957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:40.922965 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:40.923007 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:16:40.923473 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.923952 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.924597 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.924762 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.924799 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.925728 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:16:40.925729 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:16:40.925729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:16:40.925735 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:16:40.926717 (+ 982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.926977 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.926978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.926978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.927017 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:16:40.927122 (+ 105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:16:40.927122 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:16:40.927123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:16:40.927239 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:16:40.927303 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:40.927376 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 16:16:40.927428 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:16:40.928879 12607 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53476:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:16:40.930374 12607 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:16:40.936098 13350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.932318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40761 (local address 127.0.0.1:34478)
0809 16:16:40.932433 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:40.932462 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:40.932520 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:40.932772 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:40.932775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:40.932778 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:40.932836 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.932838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.933884 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.933885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.934938 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.934941 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.935818 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.935819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.935901 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.935915 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 16:16:40.935979 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 16:16:40.936031 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":60,"threads_started":1}
I20260809 16:16:40.936106 13352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.932407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34478 (local address 127.27.217.3:40761)
0809 16:16:40.932566 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:40.932571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:40.932580 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:40.932612 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:40.932614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:40.932627 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:40.932691 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:40.932916 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.933799 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.935025 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.935754 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.935818 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.935878 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:40.935998 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 16:16:40.936035 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260809 16:16:40.936757 13353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.932515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:36843 (local address 127.0.0.1:40412)
0809 16:16:40.932636 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:40.932645 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:40.932690 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:40.933285 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:40.933286 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:40.933288 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:40.933323 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.933324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.934663 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.934664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.935691 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.935694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.936538 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.936539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.936609 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.936611 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:16:40.936637 (+ 26us) client_negotiation.cc:240] Negotiation successful
0809 16:16:40.936677 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":1,"thread_start_us":70,"threads_started":1}
I20260809 16:16:40.936928 13355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.932809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46802 (local address 127.27.217.1:44945)
0809 16:16:40.933018 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:40.933022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:40.933031 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:16:40.933066 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:40.933068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:40.933083 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:40.933159 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:40.933376 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.934511 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.935620 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.936358 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.936450 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.936509 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:40.936797 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 16:16:40.936854 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":98,"threads_started":1}
I20260809 16:16:40.936883 13228 tablet_service.cc:1467] Processing CreateTablet for tablet a53f8b08f6734c07a9ba118f260c438f (DEFAULT_TABLE table=test-table [id=c848c984610b493586094e51edf86fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:40.937114 13356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.932881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40412 (local address 127.27.217.2:36843)
0809 16:16:40.933070 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:40.933073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:40.933081 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:16:40.933111 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:40.933112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:40.933123 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:40.933411 (+ 288us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:40.933487 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.934551 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.935764 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.936451 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.936914 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.936985 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:40.937011 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 16:16:40.937055 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":83,"threads_started":1}
I20260809 16:16:40.936758 13354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:40.932677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:44945 (local address 127.0.0.1:46802)
0809 16:16:40.932880 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:40.932890 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:40.932935 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:40.933200 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:40.933200 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:40.933202 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:40.933291 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.933293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.934607 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.934608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.935549 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:40.935551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:40.936541 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:40.936542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:40.936605 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:40.936609 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:16:40.936653 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:40.936683 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":12,"thread_start_us":59,"threads_started":1}
I20260809 16:16:40.937251 13228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53f8b08f6734c07a9ba118f260c438f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:40.937793 13027 tablet_service.cc:1467] Processing CreateTablet for tablet a53f8b08f6734c07a9ba118f260c438f (DEFAULT_TABLE table=test-table [id=c848c984610b493586094e51edf86fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:40.938110 13027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53f8b08f6734c07a9ba118f260c438f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:40.940555 13358 tablet_bootstrap.cc:492] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Bootstrap starting.
I20260809 16:16:40.941109 13358 tablet_bootstrap.cc:654] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:40.941169 13359 tablet_bootstrap.cc:492] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Bootstrap starting.
I20260809 16:16:40.941577 13358 log.cc:824] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:40.941565 12815 tablet_service.cc:1467] Processing CreateTablet for tablet a53f8b08f6734c07a9ba118f260c438f (DEFAULT_TABLE table=test-table [id=c848c984610b493586094e51edf86fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:16:40.941792 13359 tablet_bootstrap.cc:654] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:40.941892 12815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53f8b08f6734c07a9ba118f260c438f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:16:40.942216 13358 tablet_bootstrap.cc:492] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: No bootstrap required, opened a new log
I20260809 16:16:40.942261 13358 ts_tablet_manager.cc:1397] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:40.942313 13359 log.cc:824] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:40.943073 13359 tablet_bootstrap.cc:492] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: No bootstrap required, opened a new log
I20260809 16:16:40.943131 13359 ts_tablet_manager.cc:1397] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:40.943750 13358 raft_consensus.cc:348] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:40.943898 13358 raft_consensus.cc:374] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:40.943922 13358 raft_consensus.cc:729] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c992b194942b4179bec3788c3e96e134, State: Initialized, Role: FOLLOWER
I20260809 16:16:40.944010 13358 consensus_queue.cc:260] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:40.944240 13329 heartbeater.cc:503] Master 127.27.217.62:35177 was elected leader, sending a full tablet report...
I20260809 16:16:40.944438 13358 ts_tablet_manager.cc:1428] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:40.945103 13366 tablet_bootstrap.cc:492] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a: Bootstrap starting.
I20260809 16:16:40.945025 13359 raft_consensus.cc:348] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:40.945173 13359 raft_consensus.cc:374] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:40.945202 13359 raft_consensus.cc:729] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d380d6ca2f54aa893a43b6dd6ee6d0a, State: Initialized, Role: FOLLOWER
I20260809 16:16:40.945333 13359 consensus_queue.cc:260] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:40.945585 13130 heartbeater.cc:503] Master 127.27.217.62:35177 was elected leader, sending a full tablet report...
I20260809 16:16:40.945714 13366 tablet_bootstrap.cc:654] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a: Neither blocks nor log segments found. Creating new log.
I20260809 16:16:40.945789 13359 ts_tablet_manager.cc:1428] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:16:40.946221 13366 log.cc:824] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a: Log is configured to *not* fsync() on all Append() calls
I20260809 16:16:40.946861 13366 tablet_bootstrap.cc:492] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a: No bootstrap required, opened a new log
I20260809 16:16:40.946913 13366 ts_tablet_manager.cc:1397] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:16:40.948495 13366 raft_consensus.cc:348] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:40.948609 13366 raft_consensus.cc:374] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:16:40.948628 13366 raft_consensus.cc:729] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd6335c74a945b8a65d155a9cb0616a, State: Initialized, Role: FOLLOWER
I20260809 16:16:40.948706 13366 consensus_queue.cc:260] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:40.948928 13366 ts_tablet_manager.cc:1428] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:16:40.948974 12921 heartbeater.cc:503] Master 127.27.217.62:35177 was elected leader, sending a full tablet report...
W20260809 16:16:41.009828 13132 tablet.cc:2369] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:16:41.107066 12924 tablet.cc:2369] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:41.127858 13369 raft_consensus.cc:482] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:16:41.127983 13369 raft_consensus.cc:504] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:41.128305 13369 leader_election.cc:288] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c992b194942b4179bec3788c3e96e134 (127.27.217.3:40761), ccd6335c74a945b8a65d155a9cb0616a (127.27.217.1:44945)
I20260809 16:16:41.131109 13352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:41.128605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45561 (local address 127.27.217.3:40761)
0809 16:16:41.128665 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:41.128667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:41.128677 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:16:41.128710 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:41.128711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:41.128721 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:41.128793 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:41.128963 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.129442 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.130406 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.130782 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.130847 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:41.130856 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:41.131001 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 16:16:41.131042 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:16:41.131138 13133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:41.128503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40761 (local address 127.27.217.2:45561)
0809 16:16:41.128553 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:41.128565 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:41.128611 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:41.128813 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:41.128814 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:41.128817 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:41.128895 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:41.128898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.129533 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.129534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:41.130287 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:41.130289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.130866 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.130867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:41.130941 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:41.130944 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:41.130988 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:41.131029 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 16:16:41.131162 13355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:41.128708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:57115 (local address 127.27.217.1:44945)
0809 16:16:41.128772 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:41.128774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:41.128865 (+ 91us) server_negotiation.cc:407] Connection header received
0809 16:16:41.128927 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:41.128928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:41.128938 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:41.128983 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:16:41.129131 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.129606 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.130497 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.130850 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.130909 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:41.130918 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:41.131058 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 16:16:41.131093 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:16:41.131413 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:41.128621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:44945 (local address 127.27.217.2:57115)
0809 16:16:41.128805 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:41.128813 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:16:41.128867 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:16:41.128994 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:16:41.128994 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:16:41.128996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:16:41.129078 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:41.129079 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.129685 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.129685 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:41.130415 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:16:41.130417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.130921 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.130922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:16:41.131000 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:41.131003 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:16:41.131047 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:16:41.131086 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":118,"threads_started":1}
I20260809 16:16:41.131534 13259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53f8b08f6734c07a9ba118f260c438f" candidate_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c992b194942b4179bec3788c3e96e134" is_pre_election: true
I20260809 16:16:41.131732 13259 raft_consensus.cc:2454] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d380d6ca2f54aa893a43b6dd6ee6d0a in term 0.
I20260809 16:16:41.131748 12845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53f8b08f6734c07a9ba118f260c438f" candidate_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd6335c74a945b8a65d155a9cb0616a" is_pre_election: true
I20260809 16:16:41.131903 12845 raft_consensus.cc:2454] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d380d6ca2f54aa893a43b6dd6ee6d0a in term 0.
I20260809 16:16:41.131958 12956 leader_election.cc:302] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d380d6ca2f54aa893a43b6dd6ee6d0a, c992b194942b4179bec3788c3e96e134; no voters:
I20260809 16:16:41.132145 13369 raft_consensus.cc:2781] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:16:41.132187 13369 raft_consensus.cc:482] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:16:41.132208 13369 raft_consensus.cc:3037] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:41.132972 13369 raft_consensus.cc:504] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:41.133095 13369 leader_election.cc:288] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [CANDIDATE]: Term 1 election: Requested vote from peers c992b194942b4179bec3788c3e96e134 (127.27.217.3:40761), ccd6335c74a945b8a65d155a9cb0616a (127.27.217.1:44945)
I20260809 16:16:41.133267 13259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53f8b08f6734c07a9ba118f260c438f" candidate_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c992b194942b4179bec3788c3e96e134"
I20260809 16:16:41.133301 12845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53f8b08f6734c07a9ba118f260c438f" candidate_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd6335c74a945b8a65d155a9cb0616a"
I20260809 16:16:41.133358 13259 raft_consensus.cc:3037] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:41.133379 12845 raft_consensus.cc:3037] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:16:41.134256 12845 raft_consensus.cc:2454] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d380d6ca2f54aa893a43b6dd6ee6d0a in term 1.
I20260809 16:16:41.134275 13259 raft_consensus.cc:2454] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d380d6ca2f54aa893a43b6dd6ee6d0a in term 1.
I20260809 16:16:41.134416 12956 leader_election.cc:302] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d380d6ca2f54aa893a43b6dd6ee6d0a, ccd6335c74a945b8a65d155a9cb0616a; no voters:
I20260809 16:16:41.134506 13369 raft_consensus.cc:2781] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:16:41.134676 13369 raft_consensus.cc:686] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 1 LEADER]: Becoming Leader. State: Replica: 0d380d6ca2f54aa893a43b6dd6ee6d0a, State: Running, Role: LEADER
I20260809 16:16:41.134779 13369 consensus_queue.cc:237] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } }
I20260809 16:16:41.135635 12607 catalog_manager.cc:5495] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d380d6ca2f54aa893a43b6dd6ee6d0a (127.27.217.2). New cstate: current_term: 1 leader_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d380d6ca2f54aa893a43b6dd6ee6d0a" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 } health_report { overall_health: UNKNOWN } } }
W20260809 16:16:41.155692 13330 tablet.cc:2369] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:16:41.159569 13356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:41.157485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40422 (local address 127.27.217.2:36843)
0809 16:16:41.157534 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:16:41.157536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:16:41.157543 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:16:41.157577 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:16:41.157578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:16:41.157599 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:16:41.157673 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:16:41.157804 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.158293 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.158982 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:16:41.159161 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:16:41.159202 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:16:41.159302 (+ 100us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:16:41.159404 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:16:41.159459 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:16:41.159472 (+ 13us) server_negotiation.cc:299] Negotiation successful
0809 16:16:41.159488 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:16:41.161291 13259 raft_consensus.cc:1261] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 1 FOLLOWER]: Refusing update from remote peer 0d380d6ca2f54aa893a43b6dd6ee6d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:41.161311 12845 raft_consensus.cc:1261] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 1 FOLLOWER]: Refusing update from remote peer 0d380d6ca2f54aa893a43b6dd6ee6d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:16:41.161628 13373 consensus_queue.cc:1035] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd6335c74a945b8a65d155a9cb0616a" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 44945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:41.161751 13369 consensus_queue.cc:1035] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c992b194942b4179bec3788c3e96e134" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:16:41.164460 13377 mvcc.cc:205] Tried to move back new op lower bound from 7316652855954112512 to 7316652855848607744. Current Snapshot: MvccSnapshot[applied={T|T < 7316652855954112512}]
I20260809 16:16:41.166548 12607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:41.166633 12607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:16:41.167296 12607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dce463cc667447569f50a1af3c795d78: Sending DeleteTablet for 3 replicas of tablet a53f8b08f6734c07a9ba118f260c438f
I20260809 16:16:41.167621 13027 tablet_service.cc:1514] Processing DeleteTablet for tablet a53f8b08f6734c07a9ba118f260c438f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:41 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:40412
I20260809 16:16:41.167744 13228 tablet_service.cc:1514] Processing DeleteTablet for tablet a53f8b08f6734c07a9ba118f260c438f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:41 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:34478
I20260809 16:16:41.167874 13390 tablet_replica.cc:330] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: stopping tablet replica
I20260809 16:16:41.167943 12815 tablet_service.cc:1514] Processing DeleteTablet for tablet a53f8b08f6734c07a9ba118f260c438f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:16:41 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:46802
I20260809 16:16:41.167981 13390 raft_consensus.cc:2229] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:16:41.168087 13390 raft_consensus.cc:2258] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:41.168136 13393 tablet_replica.cc:330] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a: stopping tablet replica
I20260809 16:16:41.168290 13393 raft_consensus.cc:2229] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:41.168390 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 12707
I20260809 16:16:41.168455 13393 raft_consensus.cc:2258] T a53f8b08f6734c07a9ba118f260c438f P ccd6335c74a945b8a65d155a9cb0616a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:41.169159 13390 ts_tablet_manager.cc:1905] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:41.170885 13390 ts_tablet_manager.cc:1918] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:41.170948 13390 log.cc:1196] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/a53f8b08f6734c07a9ba118f260c438f
I20260809 16:16:41.171226 13390 ts_tablet_manager.cc:1939] T a53f8b08f6734c07a9ba118f260c438f P 0d380d6ca2f54aa893a43b6dd6ee6d0a: Deleting consensus metadata
I20260809 16:16:41.171599 12578 catalog_manager.cc:4841] TS 0d380d6ca2f54aa893a43b6dd6ee6d0a (127.27.217.2:36843): tablet a53f8b08f6734c07a9ba118f260c438f (table test-table [id=c848c984610b493586094e51edf86fc5]) successfully deleted
I20260809 16:16:41.175254 13391 tablet_replica.cc:330] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: stopping tablet replica
I20260809 16:16:41.175371 13391 raft_consensus.cc:2229] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:16:41.175475 13391 raft_consensus.cc:2258] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:16:41.175927 13391 ts_tablet_manager.cc:1905] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:16:41.177632 13391 ts_tablet_manager.cc:1918] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:16:41.177706 13391 log.cc:1196] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/a53f8b08f6734c07a9ba118f260c438f
I20260809 16:16:41.178020 13391 ts_tablet_manager.cc:1939] T a53f8b08f6734c07a9ba118f260c438f P c992b194942b4179bec3788c3e96e134: Deleting consensus metadata
I20260809 16:16:41.178453 12578 catalog_manager.cc:4841] TS c992b194942b4179bec3788c3e96e134 (127.27.217.3:40761): tablet a53f8b08f6734c07a9ba118f260c438f (table test-table [id=c848c984610b493586094e51edf86fc5]) successfully deleted
W20260809 16:16:41.180974 12578 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:44945 (error 108)
I20260809 16:16:41.181236 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 12930
I20260809 16:16:41.183079 13354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:16:41.181393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:44945 (local address 127.0.0.1:46818)
0809 16:16:41.183008 (+ 1615us) negotiation.cc:107] Waiting for socket to connect
0809 16:16:41.183051 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:44945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1595}
W20260809 16:16:41.183205 12578 catalog_manager.cc:4584] TS ccd6335c74a945b8a65d155a9cb0616a (127.27.217.1:44945): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a53f8b08f6734c07a9ba118f260c438f: Network error: Client connection negotiation failed: client connection to 127.27.217.1:44945: connect: Connection refused (error 111)
I20260809 16:16:41.189137 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 13138
I20260809 16:16:41.200414 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 12550
2026-08-09T16:16:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2201 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:16:41 dist-test-slave-nj21 krb5kdc[13402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:16:41 dist-test-slave-nj21 krb5kdc[13402](info): set up 2 sockets
Aug 09 16:16:41 dist-test-slave-nj21 krb5kdc[13402](info): commencing operation
krb5kdc: starting...
W20260809 16:16:42.332556 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:16:42 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:16:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:16:42Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.27.217.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.27.217.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/rangeradmin_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/rangeradmin_127.27.217.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.27.217.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.27.217.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/rangerlookup_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/rangerlookup_127.27.217.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.217.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.27.217.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/HTTP_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/HTTP_127.27.217.20@KRBTEST.COM.keytab.
I20260809 16:16:42.484053 28516 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXqQsw3/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/postgres -l logfile start
2026-08-09 16:16:44.756 UTC [13451] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 16:16:44.756 UTC [13451] LOG: listening on IPv4 address "127.27.217.20", port 37701
2026-08-09 16:16:44.759 UTC [13451] LOG: listening on Unix socket "/tmp/.s.PGSQL.37701"
2026-08-09 16:16:44.780 UTC [13455] LOG: database system was shut down at 2026-08-09 16:16:43 UTC
2026-08-09 16:16:44.783 UTC [13451] LOG: database system is ready to accept connections
I20260809 16:16:45.844089 28516 mini_postgres.cc:96] Postgres bound to 37701
2026-08-09 16:16:45.850 UTC [13472] FATAL: database "slave" does not exist
127.27.217.20:37701 - accepting connections
I20260809 16:16:45.851337 28516 mini_ranger.cc:161] Starting Ranger...
I20260809 16:16:45.865716 28516 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 16:16:46.282008 28516 mini_ranger.cc:87] Created ranger Postgres database
I20260809 16:16:46.282075 28516 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-admin
2026-08-09 16:16:46,555 [I] DB FLAVOR :POSTGRES
2026-08-09 16:16:46,555 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 16:16:46,555 [I] Checking connection..
2026-08-09 16:16:46,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 16:16:46,784 [I] Checking connection passed.
2026-08-09 16:16:46,785 [I] --------- Verifying version history table ---------
2026-08-09 16:16:46,785 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 16:16:47,027 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 16:16:47,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 16:16:47,285 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 16:16:47,285 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 16:16:47,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 16:16:47.519 UTC [13575] WARNING: there is no transaction in progress
2026-08-09 16:16:47,525 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 16:16:47,525 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 16:16:47,777 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 16:16:47,777 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 16:16:47,778 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 16:16:48,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 16:16:48,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-nj21.c.gcp-upstream.internal','N') ;"
2026-08-09 16:16:48,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 16:16:48,740 [I] Table x_portal_user does not exist in database ranger
2026-08-09 16:16:48,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 16:16:48,992 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 16:16:48,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 16:16:49,251 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 16:16:49,498 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 16:16:49,498 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 16:16:50.385 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.399 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.415 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.429 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.443 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.458 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.509 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.515 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.528 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.538 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.547 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.560 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.568 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.574 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.579 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:50.585 UTC [13746] WARNING: there is no transaction in progress
2026-08-09 16:16:51,156 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 16:16:51,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 16:16:51,423 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 16:16:51,423 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 16:16:51,689 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 16:16:51,690 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 16:16:51,949 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 16:16:51,950 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 16:16:52,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 16:16:52,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-nj21.c.gcp-upstream.internal';"
2026-08-09 16:16:52,697 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 16:16:52,698 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 16:16:52,958 [I] DB_PATCHES have already been applied
I20260809 16:16:52.964282 28516 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXqQsw3/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 16:16:52.964340 28516 mini_ranger.cc:193] Using host: 127.27.217.20
I20260809 16:16:52.967964 28516 mini_ranger.cc:227] Ranger admin URL: http://127.27.217.20:46907
Aug 09, 2026 4:16:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 4:16:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 4:16:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 4:16:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 4:16:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 4:16:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 4:16:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 16:16:54.175539 28516 mini_ranger.cc:160] Time spent starting Ranger: real 8.324s user 0.003s sys 0.007s
Aug 09, 2026 4:17:12 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 4:17:12 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 09, 2026 4:17:12 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 4:17:12 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 4:17:13 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 16:17:14.271802 28516 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.27.217.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.27.217.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/rangerkms_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/rangerkms_127.27.217.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.217.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.27.217.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.217.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/HTTP_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.217.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/HTTP_127.27.217.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 16:17:14 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292234, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 16:17:14.352608 28516 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 16:17:14.361529 28516 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 16:17:15.078068 28516 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 16:17:15.078135 28516 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms
I20260809 16:17:15.078150 28516 mini_ranger_kms.cc:227] Using postgres at 127.27.217.20:37701
2026-08-09 16:17:15,288 [I] DB FLAVOR :POSTGRES
2026-08-09 16:17:15,288 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 16:17:15,288 [I] Checking connection
2026-08-09 16:17:15,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 16:17:15,520 [I] connection success
2026-08-09 16:17:15,520 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 16:17:15,520 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 16:17:15,521 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 16:17:15,764 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 16:17:15,765 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 16:17:15,765 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 16:17:15,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:37701/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 16:17:16,034 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 16:17:16.498201 28516 mini_ranger_kms.cc:310] Created kms service
I20260809 16:17:16.719132 28516 mini_ranger_kms.cc:326] Created kudu user
I20260809 16:17:16.762090 28516 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 16:17:16 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292234, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:17:17.142567 28516 mini_ranger_kms.cc:384] Added ranger policy
I20260809 16:17:17.142685 28516 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 16:17:17.142707 28516 mini_ranger_kms.cc:240] Using host: 127.27.217.20
I20260809 16:17:17.146705 28516 mini_ranger_kms.cc:276] Ranger KMS PID: 14048
I20260809 16:17:17.146834 28516 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.27.217.20:38597
Aug 09, 2026 4:17:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 4:17:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 4:17:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 4:17:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 4:17:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 4:17:18 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 16:17:19 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786292239, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.217.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:17:19.663467 28516 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.311s user 0.005s sys 0.187s
I20260809 16:17:19.663584 28516 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 16:17:19.663694 28516 mini_ranger_kms.cc:401] 127.27.217.20:38597/kms/v1/keys
Aug 09 16:17:19 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292239, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.217.20@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
Aug 09 16:17:20 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292239, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.217.20@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
Aug 09 16:17:22 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:17:22.532600 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:39961
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:33285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:39961
--ranger_config_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:38597/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:17:22.612366 14135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:17:22.612552 14135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:17:22.612571 14135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:17:22.613669 14135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:17:22.613710 14135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:17:22.613723 14135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:17:22.613734 14135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:17:22.613745 14135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:17:22.615329 14135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/wal
--ranger_kms_url=127.27.217.20:38597/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:39961
--ranger_config_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:39961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:17:22.615548 14135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:17:22.615777 14135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:17:22.620740 14150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:17:22.620769 14145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:17:22.621019 14135 server_base.cc:1034] running on GCE node
W20260809 16:17:22.621197 14144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:17:22.621447 14135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:17:22.621752 14135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:17:22.622900 14135 hybrid_clock.cc:648] HybridClock initialized: now 1786292242622871 us; error 42 us; skew 500 ppm
Aug 09 16:17:22 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292242, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:17:22.627945 14135 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:17:22.628371 14135 webserver.cc:460] Webserver started at http://127.27.217.62:33249/ using document root <none> and password file <none>
I20260809 16:17:22.628580 14135 fs_manager.cc:359] Metadata directory not provided
I20260809 16:17:22.628618 14135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:17:22.628744 14135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 16:17:22 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292242, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:17:22.688833 14135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "33921653a5174207afb3c233bf2373f2"
format_stamp: "Formatted at 2026-08-09 16:17:22 on dist-test-slave-nj21"
server_key: "907d5301bd139cf7fe0a90a00f72deb7"
server_key_iv: "a6aa0da350dd5b962ce1147393c30c5e"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:22.689210 14135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "33921653a5174207afb3c233bf2373f2"
format_stamp: "Formatted at 2026-08-09 16:17:22 on dist-test-slave-nj21"
server_key: "907d5301bd139cf7fe0a90a00f72deb7"
server_key_iv: "a6aa0da350dd5b962ce1147393c30c5e"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:22.690775 14135 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:17:22.706670 14160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:22.706875 14135 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:17:22.706984 14135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "33921653a5174207afb3c233bf2373f2"
format_stamp: "Formatted at 2026-08-09 16:17:22 on dist-test-slave-nj21"
server_key: "907d5301bd139cf7fe0a90a00f72deb7"
server_key_iv: "a6aa0da350dd5b962ce1147393c30c5e"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:22.707108 14135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:17:22.731634 14135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:17:22.733537 14135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:17:22.733664 14135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:17:22.738654 14135 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:39961
I20260809 16:17:22.738705 14244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:39961 every 8 connection(s)
I20260809 16:17:22.739043 14135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:17:22.739763 14246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:17:22.742060 14246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2: Bootstrap starting.
I20260809 16:17:22.742686 14246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2: Neither blocks nor log segments found. Creating new log.
I20260809 16:17:22.742980 14246 log.cc:824] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2: Log is configured to *not* fsync() on all Append() calls
I20260809 16:17:22.743762 14246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2: No bootstrap required, opened a new log
I20260809 16:17:22.746037 14246 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33921653a5174207afb3c233bf2373f2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39961 } }
I20260809 16:17:22.746181 14246 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:17:22.746201 14246 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33921653a5174207afb3c233bf2373f2, State: Initialized, Role: FOLLOWER
I20260809 16:17:22.746330 14246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33921653a5174207afb3c233bf2373f2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39961 } }
I20260809 16:17:22.746402 14246 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:17:22.746430 14246 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:17:22.746476 14246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:17:22.746996 14246 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33921653a5174207afb3c233bf2373f2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39961 } }
I20260809 16:17:22.747084 14246 leader_election.cc:302] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33921653a5174207afb3c233bf2373f2; no voters:
I20260809 16:17:22.747247 14246 leader_election.cc:288] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:17:22.747346 14249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:17:22.747516 14246 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:17:22.747558 14249 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [term 1 LEADER]: Becoming Leader. State: Replica: 33921653a5174207afb3c233bf2373f2, State: Running, Role: LEADER
I20260809 16:17:22.747653 14249 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33921653a5174207afb3c233bf2373f2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39961 } }
I20260809 16:17:22.747998 14249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33921653a5174207afb3c233bf2373f2. Latest consensus state: current_term: 1 leader_uuid: "33921653a5174207afb3c233bf2373f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33921653a5174207afb3c233bf2373f2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39961 } } }
I20260809 16:17:22.748251 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 14135
I20260809 16:17:22.748270 14249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [sys.catalog]: This master's current role is: LEADER
I20260809 16:17:22.748354 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:17:22.748203 14251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33921653a5174207afb3c233bf2373f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33921653a5174207afb3c233bf2373f2" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39961 } } }
I20260809 16:17:22.748413 14251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2 [sys.catalog]: This master's current role is: LEADER
I20260809 16:17:22.748531 28516 external_mini_cluster.cc:1428] Setting key ba57792b9739b6ddd420ba8a2558f49d
I20260809 16:17:22.748523 14264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:17:22.749003 14264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:17:22.749581 14246 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 16:17:22.755539 14264 catalog_manager.cc:1347] Generated new cluster ID: 233b51909f89498f921ba8a8972b07c2
I20260809 16:17:22.755694 14264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:17:22 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292242, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:17:22.766069 14276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:22.749001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58958 (local address 127.27.217.62:39961)
0809 16:17:22.750115 (+ 1114us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:22.750124 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:22.751788 (+ 1664us) server_negotiation.cc:407] Connection header received
0809 16:17:22.752290 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:22.752305 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:22.752635 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:22.752838 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:17:22.756364 (+ 3526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:22.757931 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:22.758707 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:22.759421 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:22.759544 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:22.761960 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:17:22.761968 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:17:22.761969 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:17:22.761981 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:17:22.764387 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:22.764717 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:22.764721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:22.764721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:22.764849 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:22.765035 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:22.765036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:22.765036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:22.765387 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:17:22.765592 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:22.765660 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 16:17:22.765790 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":1064,"thread_start_us":66,"threads_started":1}
I20260809 16:17:22.780946 14264 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:17:22.781720 14264 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:17:22.785265 14264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2: Generated new TSK 0
I20260809 16:17:22.785523 14264 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:17:23.571092 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:38597/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39961
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:33285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:17:23.687911 14323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:17:23.688226 14323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:17:23.688293 14323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:17:23.689996 14323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:17:23.690100 14323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:17:23.690181 14323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:17:23.692289 14323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.27.217.20:38597/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:17:23.692757 14323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:17:23.693070 14323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:17:23.699501 14331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:17:23.699826 14334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:17:23.700284 14330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:17:23.706558 14323 server_base.cc:1034] running on GCE node
I20260809 16:17:23.706775 14323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:17:23.707037 14323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:17:23.708184 14323 hybrid_clock.cc:648] HybridClock initialized: now 1786292243708161 us; error 35 us; skew 500 ppm
Aug 09 16:17:23 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292243, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:17:23.711501 14323 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:17:23.712088 14323 webserver.cc:460] Webserver started at http://127.27.217.1:39157/ using document root <none> and password file <none>
I20260809 16:17:23.712366 14323 fs_manager.cc:359] Metadata directory not provided
I20260809 16:17:23.712440 14323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:17:23.712576 14323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 16:17:23 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292243, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:17:23.726687 14323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "3893b8051be74bc9bbac55b0938a9e6f"
format_stamp: "Formatted at 2026-08-09 16:17:23 on dist-test-slave-nj21"
server_key: "55c3659dfd15f16e3ba23fb1936d45b2"
server_key_iv: "d477f817b9e2ab5d6c59a579d580bdff"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:23.727258 14323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "3893b8051be74bc9bbac55b0938a9e6f"
format_stamp: "Formatted at 2026-08-09 16:17:23 on dist-test-slave-nj21"
server_key: "55c3659dfd15f16e3ba23fb1936d45b2"
server_key_iv: "d477f817b9e2ab5d6c59a579d580bdff"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:23.729233 14323 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260809 16:17:23.743199 14346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:23.743454 14323 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 16:17:23.743603 14323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "3893b8051be74bc9bbac55b0938a9e6f"
format_stamp: "Formatted at 2026-08-09 16:17:23 on dist-test-slave-nj21"
server_key: "55c3659dfd15f16e3ba23fb1936d45b2"
server_key_iv: "d477f817b9e2ab5d6c59a579d580bdff"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:23.743839 14323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:17:23.770411 14323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:17:23.772739 14323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:17:23.772883 14323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:17:23.773129 14323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:17:23.773572 14323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:17:23.773630 14323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:23.773660 14323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:17:23.773711 14323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:23.780483 14323 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:34317
I20260809 16:17:23.780983 14323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:17:23.791272 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 14323
I20260809 16:17:23.791375 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:17:23.791586 28516 external_mini_cluster.cc:1428] Setting key 7fe94fb7d73fdb441188159bb9476f98
I20260809 16:17:23.791961 14526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:34317 every 8 connection(s)
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Aug 09 16:17:23 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292243, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:17:23.810153 14535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:23.795485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:49005 (local address 127.27.217.62:39961)
0809 16:17:23.798358 (+ 2873us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:23.798360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:23.799246 (+ 886us) server_negotiation.cc:407] Connection header received
0809 16:17:23.799277 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:23.799278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:23.799292 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:23.799347 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:17:23.800168 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:23.800899 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:23.802011 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:23.802235 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:23.802296 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:23.807150 (+ 4854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:17:23.807152 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:17:23.807152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:17:23.807161 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:17:23.808753 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:23.809132 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:23.809133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:23.809133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:23.809200 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:23.809477 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:23.809478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:23.809478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:23.809618 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:17:23.809671 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:23.809964 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 16:17:23.810050 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2846,"thread_start_us":60,"threads_started":1}
I20260809 16:17:23.810283 14534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:23.795165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:39961 (local address 127.27.217.1:49005)
0809 16:17:23.798434 (+ 3269us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:23.798486 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 16:17:23.799098 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:17:23.799480 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:17:23.799485 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:17:23.799763 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:17:23.800052 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:23.800058 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:23.801009 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:23.801010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:23.801909 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:23.801912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:23.802314 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:23.802315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:23.802441 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:23.802951 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:17:23.802960 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:17:23.807064 (+ 4104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:17:23.808824 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:17:23.808831 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:17:23.808833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:17:23.809051 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:17:23.809256 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:17:23.809257 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:17:23.809257 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:17:23.809367 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:17:23.809677 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:17:23.809684 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:17:23.809831 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 16:17:23.809912 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 16:17:23.810057 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3221,"thread_start_us":101,"threads_started":1}
I20260809 16:17:23.810930 14527 heartbeater.cc:347] Connected to a master server at 127.27.217.62:39961
I20260809 16:17:23.811024 14527 heartbeater.cc:464] Registering TS with master...
I20260809 16:17:23.811193 14527 heartbeater.cc:511] Master 127.27.217.62:39961 requested a full tablet report, sending...
I20260809 16:17:23.811740 14189 ts_manager.cc:194] Registered new tserver with Master: 3893b8051be74bc9bbac55b0938a9e6f (127.27.217.1:34317)
I20260809 16:17:23.812533 14189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:49005
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:17:23.826586 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:38597/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39961
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:33285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 16:17:23 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786292243, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 16:17:23.949776 14539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:17:23.950127 14539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:17:23.950203 14539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:17:23.952025 14539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:17:23.952090 14539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:17:23.952127 14539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:17:23.954278 14539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.27.217.20:38597/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:17:23.954516 14539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:17:23.954813 14539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:17:23.960690 14553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:17:23.960860 14555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:17:23.961105 14552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:17:23.961369 14539 server_base.cc:1034] running on GCE node
I20260809 16:17:23.961555 14539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:17:23.961812 14539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:17:23.962963 14539 hybrid_clock.cc:648] HybridClock initialized: now 1786292243962947 us; error 32 us; skew 500 ppm
Aug 09 16:17:23 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292243, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:17:23.966195 14539 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:17:23.966710 14539 webserver.cc:460] Webserver started at http://127.27.217.2:39867/ using document root <none> and password file <none>
I20260809 16:17:23.966972 14539 fs_manager.cc:359] Metadata directory not provided
I20260809 16:17:23.967036 14539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:17:23.967163 14539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 16:17:23 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292243, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:17:23.990424 14539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "5a875a940c8f4454837682bd61d1f62d"
format_stamp: "Formatted at 2026-08-09 16:17:23 on dist-test-slave-nj21"
server_key: "a1d849c7fd7c13652fa782c2d54fe3fc"
server_key_iv: "2ba1c8112a033041735c8125d012d514"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:23.990945 14539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "5a875a940c8f4454837682bd61d1f62d"
format_stamp: "Formatted at 2026-08-09 16:17:23 on dist-test-slave-nj21"
server_key: "a1d849c7fd7c13652fa782c2d54fe3fc"
server_key_iv: "2ba1c8112a033041735c8125d012d514"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:23.993192 14539 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 16:17:24.008841 14573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:24.009093 14539 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260809 16:17:24.009181 14539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "5a875a940c8f4454837682bd61d1f62d"
format_stamp: "Formatted at 2026-08-09 16:17:23 on dist-test-slave-nj21"
server_key: "a1d849c7fd7c13652fa782c2d54fe3fc"
server_key_iv: "2ba1c8112a033041735c8125d012d514"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:24.009281 14539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:17:24.045414 14539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:17:24.047998 14539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:17:24.048202 14539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:17:24.048537 14539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:17:24.048970 14539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:17:24.049075 14539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:24.049147 14539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:17:24.049203 14539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:24.055594 14539 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:33721
I20260809 16:17:24.056155 14539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:17:24.058908 14766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:33721 every 8 connection(s)
I20260809 16:17:24.066363 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 14539
I20260809 16:17:24.066475 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:17:24.066654 28516 external_mini_cluster.cc:1428] Setting key 8bf263edd756394f058da8e8ff65c9d6
Aug 09 16:17:24 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292243, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:17:24.073681 14535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.059771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:38515 (local address 127.27.217.62:39961)
0809 16:17:24.059825 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.059828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.060256 (+ 428us) server_negotiation.cc:407] Connection header received
0809 16:17:24.060978 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.060980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.060995 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.061074 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:17:24.061831 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.062610 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.064443 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.064879 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.064930 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.070283 (+ 5353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:17:24.070285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:17:24.070285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:17:24.070293 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:17:24.072016 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:24.072539 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:24.072541 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:24.072541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:24.072603 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:24.072899 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:24.072900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:24.072901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:24.073043 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:17:24.073098 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.073485 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.073583 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:17:24.074471 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.059552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:39961 (local address 127.27.217.2:38515)
0809 16:17:24.060123 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:24.060169 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 16:17:24.060838 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:17:24.061171 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:17:24.061176 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:17:24.061437 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:17:24.061716 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.061722 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.062727 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.062728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.064267 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.064279 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.065025 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.065026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.065169 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.065743 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:17:24.065753 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:17:24.070150 (+ 4397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:17:24.072116 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:17:24.072123 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:17:24.072125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:17:24.072446 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:17:24.072672 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:17:24.072673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:17:24.072673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:17:24.072813 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:17:24.073133 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:17:24.073140 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:17:24.073317 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 16:17:24.074048 (+ 731us) client_negotiation.cc:240] Negotiation successful
0809 16:17:24.074218 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":81,"threads_started":1}
I20260809 16:17:24.075208 14768 heartbeater.cc:347] Connected to a master server at 127.27.217.62:39961
I20260809 16:17:24.075323 14768 heartbeater.cc:464] Registering TS with master...
I20260809 16:17:24.075520 14768 heartbeater.cc:511] Master 127.27.217.62:39961 requested a full tablet report, sending...
I20260809 16:17:24.075982 14189 ts_manager.cc:194] Registered new tserver with Master: 5a875a940c8f4454837682bd61d1f62d (127.27.217.2:33721)
I20260809 16:17:24.076454 14189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:38515
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:17:24.124280 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:38597/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39961
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:33285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:17:24.232126 14778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:17:24.232530 14778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:17:24.232587 14778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:17:24.233769 14778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:17:24.233812 14778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:17:24.233846 14778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:17:24.235828 14778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:33285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.27.217.20:38597/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:39961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:17:24.236361 14778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:17:24.236747 14778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:17:24.242798 14785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:17:24.242789 14786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:17:24.243335 14788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:17:24.243875 14778 server_base.cc:1034] running on GCE node
I20260809 16:17:24.244062 14778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:17:24.244302 14778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:17:24.245453 14778 hybrid_clock.cc:648] HybridClock initialized: now 1786292244245449 us; error 32 us; skew 500 ppm
Aug 09 16:17:24 dist-test-slave-nj21 krb5kdc[13402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292244, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:17:24.248517 14778 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:17:24.249281 14778 webserver.cc:460] Webserver started at http://127.27.217.3:32839/ using document root <none> and password file <none>
I20260809 16:17:24.249626 14778 fs_manager.cc:359] Metadata directory not provided
I20260809 16:17:24.249679 14778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:17:24.249809 14778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 16:17:24 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292244, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:17:24.286082 14778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "89677fc2b39849eb8da1e6d082849ab3"
format_stamp: "Formatted at 2026-08-09 16:17:24 on dist-test-slave-nj21"
server_key: "b2513f1b371195b7535711e9862ab2d3"
server_key_iv: "a9927e7745f0cf8ba1ecac39960dc080"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:24.286552 14778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "89677fc2b39849eb8da1e6d082849ab3"
format_stamp: "Formatted at 2026-08-09 16:17:24 on dist-test-slave-nj21"
server_key: "b2513f1b371195b7535711e9862ab2d3"
server_key_iv: "a9927e7745f0cf8ba1ecac39960dc080"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:24.288570 14778 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 16:17:24.305546 14801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:24.305832 14778 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:17:24.305932 14778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "89677fc2b39849eb8da1e6d082849ab3"
format_stamp: "Formatted at 2026-08-09 16:17:24 on dist-test-slave-nj21"
server_key: "b2513f1b371195b7535711e9862ab2d3"
server_key_iv: "a9927e7745f0cf8ba1ecac39960dc080"
server_key_version: "kuduclusterkey@0"
I20260809 16:17:24.306022 14778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:17:24.339426 14778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:17:24.341804 14778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:17:24.341992 14778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:17:24.342284 14778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:17:24.342694 14778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:17:24.342775 14778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:24.342847 14778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:17:24.342903 14778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:17:24.350008 14778 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:40933
I20260809 16:17:24.350692 14778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:17:24.351907 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 14778
I20260809 16:17:24.352018 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:17:24.352216 28516 external_mini_cluster.cc:1428] Setting key 987b15311d3bbf9d797d3bc3ac0098f9
I20260809 16:17:24.353210 15006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:40933 every 8 connection(s)
Aug 09 16:17:24 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292244, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:17:24.364153 14535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.353795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:48829 (local address 127.27.217.62:39961)
0809 16:17:24.353837 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.353840 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.354102 (+ 262us) server_negotiation.cc:407] Connection header received
0809 16:17:24.354741 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.354742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.354753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.354786 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:17:24.355570 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.356382 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.357824 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.358130 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.358168 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.360632 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:17:24.360634 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:17:24.360634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:17:24.360641 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:17:24.362220 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:24.362676 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:24.362677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:24.362678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:24.362733 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:24.362980 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:24.362981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:24.362982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:24.363108 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:17:24.363147 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.363972 (+ 825us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.364057 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:17:24.364979 15012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.353773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:39961 (local address 127.27.217.3:48829)
0809 16:17:24.353985 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:24.354025 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:17:24.354631 (+ 606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:17:24.354954 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:17:24.354958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:17:24.355184 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:17:24.355467 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.355472 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.356489 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.356489 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.357720 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.357723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.358249 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.358250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.358400 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.358924 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:17:24.358934 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:17:24.360534 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:17:24.362312 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:17:24.362318 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:17:24.362320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:17:24.362598 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:17:24.362794 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:17:24.362795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:17:24.362795 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:17:24.362913 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:17:24.363190 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:17:24.363196 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:17:24.363809 (+ 613us) client_negotiation.cc:769] Sending connection context
0809 16:17:24.364581 (+ 772us) client_negotiation.cc:240] Negotiation successful
0809 16:17:24.364739 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":90,"threads_started":1}
I20260809 16:17:24.365602 15009 heartbeater.cc:347] Connected to a master server at 127.27.217.62:39961
I20260809 16:17:24.365690 15009 heartbeater.cc:464] Registering TS with master...
I20260809 16:17:24.365860 15009 heartbeater.cc:511] Master 127.27.217.62:39961 requested a full tablet report, sending...
I20260809 16:17:24.366248 14189 ts_manager.cc:194] Registered new tserver with Master: 89677fc2b39849eb8da1e6d082849ab3 (127.27.217.3:40933)
I20260809 16:17:24.366726 14189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:48829
I20260809 16:17:24.375066 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:17:24.384297 14535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.376939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58974 (local address 127.27.217.62:39961)
0809 16:17:24.376980 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.376982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.377008 (+ 26us) server_negotiation.cc:407] Connection header received
0809 16:17:24.377069 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.377070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.377079 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.377122 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:17:24.377818 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.378584 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.379642 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.379955 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.380015 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.381440 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:17:24.381442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:17:24.381442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:17:24.381449 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:17:24.383036 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:24.383420 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:24.383421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:24.383421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:24.383476 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:17:24.383724 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:17:24.383725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:17:24.383726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:17:24.383853 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:17:24.383925 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.384128 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.384205 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:17:24.386394 14189 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58974:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:17:24.388680 14189 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:17:24.401335 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.391395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:33721 (local address 127.0.0.1:42466)
0809 16:17:24.396320 (+ 4925us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:24.396329 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:17:24.396382 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:17:24.396698 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:17:24.396702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:17:24.396704 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:17:24.396772 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.396773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.398311 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.398312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.399627 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.399630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.401021 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.401022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.401110 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.401124 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 16:17:24.401190 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 16:17:24.401243 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4908,"thread_start_us":96,"threads_started":1}
I20260809 16:17:24.401993 15034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.391511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42466 (local address 127.27.217.2:33721)
0809 16:17:24.391736 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.391741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.396438 (+ 4697us) server_negotiation.cc:407] Connection header received
0809 16:17:24.396497 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.396500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.396516 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.396584 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:17:24.396845 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.398219 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.400035 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.400839 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.400907 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.400986 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.401861 (+ 875us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.401911 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":91,"threads_started":1}
I20260809 16:17:24.403688 14653 tablet_service.cc:1467] Processing CreateTablet for tablet 14e8a47adae64f13b012c72dc0bc192e (DEFAULT_TABLE table=test-table [id=9a5f5a45af9c40168da284fe64f94c3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:17:24.404099 14653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e8a47adae64f13b012c72dc0bc192e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:17:24.406523 15033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.391390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40933 (local address 127.0.0.1:34796)
0809 16:17:24.395805 (+ 4415us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:24.395861 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 16:17:24.396173 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:17:24.402698 (+ 6525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:17:24.402699 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:17:24.402701 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:17:24.402739 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.402740 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.404315 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.404316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.405348 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.405351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.406296 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.406298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.406359 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.406364 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:17:24.406409 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 16:17:24.406445 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4369,"thread_start_us":98,"threads_started":1}
I20260809 16:17:24.406863 15037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.391927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34796 (local address 127.27.217.3:40933)
0809 16:17:24.402536 (+ 10609us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.402541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.402552 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:17:24.402586 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.402588 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.402603 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.402802 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:17:24.402874 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.404214 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.405482 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.406198 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.406632 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.406719 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.406748 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.406784 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10567,"thread_start_us":97,"threads_started":1}
I20260809 16:17:24.407524 14879 tablet_service.cc:1467] Processing CreateTablet for tablet 14e8a47adae64f13b012c72dc0bc192e (DEFAULT_TABLE table=test-table [id=9a5f5a45af9c40168da284fe64f94c3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:17:24.407895 14879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e8a47adae64f13b012c72dc0bc192e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:17:24.412261 15039 tablet_bootstrap.cc:492] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: Bootstrap starting.
I20260809 16:17:24.412395 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.391781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53984 (local address 127.27.217.1:34317)
0809 16:17:24.395765 (+ 3984us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.395771 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.401797 (+ 6026us) server_negotiation.cc:407] Connection header received
0809 16:17:24.401843 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.401845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.401864 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.401958 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:17:24.402152 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.403147 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.411169 (+ 8022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.411958 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.412003 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.412057 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.412278 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.412324 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3941,"thread_start_us":122,"threads_started":1}
I20260809 16:17:24.412771 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.391646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:34317 (local address 127.0.0.1:53984)
0809 16:17:24.401737 (+ 10091us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:24.401746 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:17:24.401791 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:17:24.402037 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:17:24.402038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:17:24.402040 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:17:24.402072 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.402074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.408279 (+ 6205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.408280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.409282 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.409285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.412120 (+ 2835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.412121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.412182 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.412186 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:17:24.412654 (+ 468us) client_negotiation.cc:240] Negotiation successful
0809 16:17:24.412706 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10079,"thread_start_us":109,"threads_started":1}
I20260809 16:17:24.413601 14420 tablet_service.cc:1467] Processing CreateTablet for tablet 14e8a47adae64f13b012c72dc0bc192e (DEFAULT_TABLE table=test-table [id=9a5f5a45af9c40168da284fe64f94c3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:17:24.413923 14420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e8a47adae64f13b012c72dc0bc192e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:17:24.417984 15039 tablet_bootstrap.cc:654] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: Neither blocks nor log segments found. Creating new log.
I20260809 16:17:24.418345 15039 log.cc:824] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: Log is configured to *not* fsync() on all Append() calls
I20260809 16:17:24.418722 15040 tablet_bootstrap.cc:492] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f: Bootstrap starting.
I20260809 16:17:24.419518 15040 tablet_bootstrap.cc:654] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f: Neither blocks nor log segments found. Creating new log.
I20260809 16:17:24.419987 15040 log.cc:824] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f: Log is configured to *not* fsync() on all Append() calls
I20260809 16:17:24.420878 15039 tablet_bootstrap.cc:492] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: No bootstrap required, opened a new log
I20260809 16:17:24.420994 15039 ts_tablet_manager.cc:1397] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260809 16:17:24.423008 15039 raft_consensus.cc:348] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.423273 15039 raft_consensus.cc:374] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:17:24.423355 15039 raft_consensus.cc:729] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89677fc2b39849eb8da1e6d082849ab3, State: Initialized, Role: FOLLOWER
I20260809 16:17:24.423627 15039 consensus_queue.cc:260] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.423840 15038 tablet_bootstrap.cc:492] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: Bootstrap starting.
I20260809 16:17:24.424358 15039 ts_tablet_manager.cc:1428] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:17:24.424551 15009 heartbeater.cc:503] Master 127.27.217.62:39961 was elected leader, sending a full tablet report...
I20260809 16:17:24.424962 15038 tablet_bootstrap.cc:654] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: Neither blocks nor log segments found. Creating new log.
I20260809 16:17:24.425269 15038 log.cc:824] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: Log is configured to *not* fsync() on all Append() calls
Aug 09 16:17:24 dist-test-slave-nj21 krb5kdc[13402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292243, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:17:24.426080 15038 tablet_bootstrap.cc:492] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: No bootstrap required, opened a new log
I20260809 16:17:24.426146 15038 ts_tablet_manager.cc:1397] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:17:24.426673 15040 tablet_bootstrap.cc:492] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f: No bootstrap required, opened a new log
I20260809 16:17:24.426730 15040 ts_tablet_manager.cc:1397] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260809 16:17:24.428158 15038 raft_consensus.cc:348] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.428305 15038 raft_consensus.cc:374] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:17:24.428336 15038 raft_consensus.cc:729] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a875a940c8f4454837682bd61d1f62d, State: Initialized, Role: FOLLOWER
I20260809 16:17:24.428565 15038 consensus_queue.cc:260] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.428880 15038 ts_tablet_manager.cc:1428] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:17:24.429029 14768 heartbeater.cc:503] Master 127.27.217.62:39961 was elected leader, sending a full tablet report...
I20260809 16:17:24.429139 15040 raft_consensus.cc:348] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.429270 15040 raft_consensus.cc:374] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:17:24.429303 15040 raft_consensus.cc:729] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3893b8051be74bc9bbac55b0938a9e6f, State: Initialized, Role: FOLLOWER
I20260809 16:17:24.429433 15040 consensus_queue.cc:260] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.429703 15040 ts_tablet_manager.cc:1428] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260809 16:17:24.429845 14527 heartbeater.cc:503] Master 127.27.217.62:39961 was elected leader, sending a full tablet report...
I20260809 16:17:24.507951 15051 raft_consensus.cc:482] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:17:24.508086 15051 raft_consensus.cc:504] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.508498 15051 leader_election.cc:288] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a875a940c8f4454837682bd61d1f62d (127.27.217.2:33721), 3893b8051be74bc9bbac55b0938a9e6f (127.27.217.1:34317)
I20260809 16:17:24.512533 15063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.508670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:33721 (local address 127.27.217.3:41417)
0809 16:17:24.508998 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:24.509007 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:17:24.509079 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:17:24.509245 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:17:24.509246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:17:24.509247 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:17:24.509308 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.509309 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.510278 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.510279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.511558 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.511560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.512268 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.512270 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.512344 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.512361 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 16:17:24.512412 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 16:17:24.512451 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":304,"thread_start_us":107,"threads_started":1}
I20260809 16:17:24.512562 15034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.508772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:41417 (local address 127.27.217.2:33721)
0809 16:17:24.508814 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.508815 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.509056 (+ 241us) server_negotiation.cc:407] Connection header received
0809 16:17:24.509149 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.509150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.509161 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.509188 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:17:24.509397 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.510144 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.511646 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.512157 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.512202 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.512212 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.512447 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.512495 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:17:24.512787 15012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.508670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:34317 (local address 127.27.217.3:40343)
0809 16:17:24.508779 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:24.508790 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:17:24.508834 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:17:24.509183 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:17:24.509184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:17:24.509186 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:17:24.509254 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.509256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.510278 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.510279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.511510 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:17:24.511514 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.512567 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.512568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:17:24.512639 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.512642 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:17:24.512695 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:17:24.512729 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 16:17:24.512805 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.508930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:40343 (local address 127.27.217.1:34317)
0809 16:17:24.508974 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.508976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.508984 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:17:24.509011 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.509012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.509023 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.509066 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:17:24.509326 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.510141 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.511942 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.512473 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.512528 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.512536 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.512706 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.512749 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:17:24.513253 14466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e8a47adae64f13b012c72dc0bc192e" candidate_uuid: "89677fc2b39849eb8da1e6d082849ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3893b8051be74bc9bbac55b0938a9e6f" is_pre_election: true
I20260809 16:17:24.513302 14687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e8a47adae64f13b012c72dc0bc192e" candidate_uuid: "89677fc2b39849eb8da1e6d082849ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a875a940c8f4454837682bd61d1f62d" is_pre_election: true
I20260809 16:17:24.513449 14687 raft_consensus.cc:2454] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89677fc2b39849eb8da1e6d082849ab3 in term 0.
I20260809 16:17:24.513449 14466 raft_consensus.cc:2454] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89677fc2b39849eb8da1e6d082849ab3 in term 0.
I20260809 16:17:24.513687 14808 leader_election.cc:302] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a875a940c8f4454837682bd61d1f62d, 89677fc2b39849eb8da1e6d082849ab3; no voters:
I20260809 16:17:24.513828 15051 raft_consensus.cc:2781] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:17:24.513866 15051 raft_consensus.cc:482] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:17:24.513885 15051 raft_consensus.cc:3037] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:17:24.514838 15051 raft_consensus.cc:504] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.514964 15051 leader_election.cc:288] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 5a875a940c8f4454837682bd61d1f62d (127.27.217.2:33721), 3893b8051be74bc9bbac55b0938a9e6f (127.27.217.1:34317)
I20260809 16:17:24.515120 14466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e8a47adae64f13b012c72dc0bc192e" candidate_uuid: "89677fc2b39849eb8da1e6d082849ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3893b8051be74bc9bbac55b0938a9e6f"
I20260809 16:17:24.515146 14687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e8a47adae64f13b012c72dc0bc192e" candidate_uuid: "89677fc2b39849eb8da1e6d082849ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a875a940c8f4454837682bd61d1f62d"
I20260809 16:17:24.515190 14466 raft_consensus.cc:3037] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:17:24.515228 14687 raft_consensus.cc:3037] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:17:24.516068 14466 raft_consensus.cc:2454] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89677fc2b39849eb8da1e6d082849ab3 in term 1.
I20260809 16:17:24.516073 14687 raft_consensus.cc:2454] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89677fc2b39849eb8da1e6d082849ab3 in term 1.
I20260809 16:17:24.516244 14805 leader_election.cc:302] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3893b8051be74bc9bbac55b0938a9e6f, 89677fc2b39849eb8da1e6d082849ab3; no voters:
I20260809 16:17:24.516405 15051 raft_consensus.cc:2781] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:17:24.516552 15051 raft_consensus.cc:686] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 89677fc2b39849eb8da1e6d082849ab3, State: Running, Role: LEADER
I20260809 16:17:24.516641 15051 consensus_queue.cc:237] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } }
I20260809 16:17:24.517428 14189 catalog_manager.cc:5495] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89677fc2b39849eb8da1e6d082849ab3 (127.27.217.3). New cstate: current_term: 1 leader_uuid: "89677fc2b39849eb8da1e6d082849ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89677fc2b39849eb8da1e6d082849ab3" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 } health_report { overall_health: UNKNOWN } } }
W20260809 16:17:24.545253 14531 tablet.cc:2369] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:17:24.549021 15037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.542781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34808 (local address 127.27.217.3:40933)
0809 16:17:24.545488 (+ 2707us) server_negotiation.cc:206] Beginning negotiation
0809 16:17:24.545491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:17:24.545501 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:17:24.545542 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:17:24.545543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:17:24.545568 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:17:24.545644 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:17:24.545828 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.546577 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.548075 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:17:24.548415 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:17:24.548481 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:17:24.548666 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:17:24.548802 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:17:24.548880 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 16:17:24.548924 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 16:17:24.548946 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2680}
I20260809 16:17:24.551071 14466 raft_consensus.cc:1261] T 14e8a47adae64f13b012c72dc0bc192e P 3893b8051be74bc9bbac55b0938a9e6f [term 1 FOLLOWER]: Refusing update from remote peer 89677fc2b39849eb8da1e6d082849ab3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:17:24.551072 14687 raft_consensus.cc:1261] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 1 FOLLOWER]: Refusing update from remote peer 89677fc2b39849eb8da1e6d082849ab3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:17:24.551409 15065 consensus_queue.cc:1035] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a875a940c8f4454837682bd61d1f62d" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 33721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:17:24.551544 15051 consensus_queue.cc:1035] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3893b8051be74bc9bbac55b0938a9e6f" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 34317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:17:24.554461 15069 mvcc.cc:205] Tried to move back new op lower bound from 7316653033678241792 to 7316653033540849664. Current Snapshot: MvccSnapshot[applied={T|T < 7316653033678241792}]
I20260809 16:17:24.556080 15073 mvcc.cc:205] Tried to move back new op lower bound from 7316653033678241792 to 7316653033540849664. Current Snapshot: MvccSnapshot[applied={T|T < 7316653033678241792}]
I20260809 16:17:24.557802 14188 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58974:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:17:24.557890 14188 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58974:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:17:24.558672 14188 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33921653a5174207afb3c233bf2373f2: Sending DeleteTablet for 3 replicas of tablet 14e8a47adae64f13b012c72dc0bc192e
I20260809 16:17:24.558992 14879 tablet_service.cc:1514] Processing DeleteTablet for tablet 14e8a47adae64f13b012c72dc0bc192e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:17:24 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:34796
I20260809 16:17:24.559617 14653 tablet_service.cc:1514] Processing DeleteTablet for tablet 14e8a47adae64f13b012c72dc0bc192e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:17:24 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:42466
I20260809 16:17:24.559966 14420 tablet_service.cc:1514] Processing DeleteTablet for tablet 14e8a47adae64f13b012c72dc0bc192e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:17:24 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:53984
I20260809 16:17:24.560451 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 14323
I20260809 16:17:24.571614 15084 tablet_replica.cc:330] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: stopping tablet replica
I20260809 16:17:24.571830 15084 raft_consensus.cc:2229] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:17:24.572036 15084 raft_consensus.cc:2258] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:17:24.572568 15084 ts_tablet_manager.cc:1905] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:17:24.574249 15084 ts_tablet_manager.cc:1918] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:17:24.574391 15084 log.cc:1196] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/14e8a47adae64f13b012c72dc0bc192e
I20260809 16:17:24.574707 15084 ts_tablet_manager.cc:1939] T 14e8a47adae64f13b012c72dc0bc192e P 5a875a940c8f4454837682bd61d1f62d: Deleting consensus metadata
I20260809 16:17:24.575186 14164 catalog_manager.cc:4841] TS 5a875a940c8f4454837682bd61d1f62d (127.27.217.2:33721): tablet 14e8a47adae64f13b012c72dc0bc192e (table test-table [id=9a5f5a45af9c40168da284fe64f94c3b]) successfully deleted
I20260809 16:17:24.578001 15081 tablet_replica.cc:330] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: stopping tablet replica
I20260809 16:17:24.578126 15081 raft_consensus.cc:2229] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:17:24.578239 15081 raft_consensus.cc:2258] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:17:24.578792 15081 ts_tablet_manager.cc:1905] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:17:24.580616 15081 ts_tablet_manager.cc:1918] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:17:24.580741 15081 log.cc:1196] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/14e8a47adae64f13b012c72dc0bc192e
I20260809 16:17:24.581037 15081 ts_tablet_manager.cc:1939] T 14e8a47adae64f13b012c72dc0bc192e P 89677fc2b39849eb8da1e6d082849ab3: Deleting consensus metadata
I20260809 16:17:24.581477 14162 catalog_manager.cc:4841] TS 89677fc2b39849eb8da1e6d082849ab3 (127.27.217.3:40933): tablet 14e8a47adae64f13b012c72dc0bc192e (table test-table [id=9a5f5a45af9c40168da284fe64f94c3b]) successfully deleted
W20260809 16:17:24.587980 14161 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:34317 (error 108)
I20260809 16:17:24.588274 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 14539
I20260809 16:17:24.635892 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:17:24.602860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:34317 (local address 127.0.0.1:53990)
0809 16:17:24.635754 (+ 32894us) negotiation.cc:107] Waiting for socket to connect
0809 16:17:24.635838 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:34317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32860}
W20260809 16:17:24.636075 14161 catalog_manager.cc:4584] TS 3893b8051be74bc9bbac55b0938a9e6f (127.27.217.1:34317): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 14e8a47adae64f13b012c72dc0bc192e: Network error: Client connection negotiation failed: client connection to 127.27.217.1:34317: connect: Connection refused (error 111)
I20260809 16:17:24.641717 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 14778
I20260809 16:17:24.657869 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 14135
I20260809 16:17:24.675094 28516 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 16:17:25.019750 28516 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 16:17:25.019858 28516 mini_ranger.cc:66] Stopping Ranger...
I20260809 16:17:25.373636 28516 mini_ranger.cc:68] Stopped Ranger
2026-08-09 16:17:25.373 UTC [13451] LOG: received smart shutdown request
2026-08-09 16:17:25.377 UTC [13451] LOG: background worker "logical replication launcher" (PID 13470) exited with exit code 1
2026-08-09 16:17:25.377 UTC [13457] LOG: shutting down
2026-08-09 16:17:25.515 UTC [13451] LOG: database system is shut down
2026-08-09T16:17:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (44408 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:17:25 dist-test-slave-nj21 krb5kdc[15098](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:17:25 dist-test-slave-nj21 krb5kdc[15098](info): set up 2 sockets
Aug 09 16:17:25 dist-test-slave-nj21 krb5kdc[15098](info): commencing operation
krb5kdc: starting...
W20260809 16:17:26.757916 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:17:26 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:17:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:17:26Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.27.217.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.27.217.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/rangeradmin_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/rangeradmin_127.27.217.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.27.217.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.27.217.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/rangerlookup_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/rangerlookup_127.27.217.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.217.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.27.217.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/HTTP_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/HTTP_127.27.217.20@KRBTEST.COM.keytab.
I20260809 16:17:26.910621 28516 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXqQsw3/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/postgres -l logfile start
2026-08-09 16:17:29.204 UTC [15156] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 16:17:29.205 UTC [15156] LOG: listening on IPv4 address "127.27.217.20", port 35171
2026-08-09 16:17:29.208 UTC [15156] LOG: listening on Unix socket "/tmp/.s.PGSQL.35171"
2026-08-09 16:17:29.228 UTC [15161] LOG: database system was shut down at 2026-08-09 16:17:27 UTC
2026-08-09 16:17:29.232 UTC [15156] LOG: database system is ready to accept connections
I20260809 16:17:30.293191 28516 mini_postgres.cc:96] Postgres bound to 35171
2026-08-09 16:17:30.299 UTC [15173] FATAL: database "slave" does not exist
127.27.217.20:35171 - accepting connections
I20260809 16:17:30.300293 28516 mini_ranger.cc:161] Starting Ranger...
I20260809 16:17:30.314920 28516 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 16:17:30.747445 28516 mini_ranger.cc:87] Created ranger Postgres database
I20260809 16:17:30.747524 28516 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-admin
2026-08-09 16:17:31,013 [I] DB FLAVOR :POSTGRES
2026-08-09 16:17:31,013 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 16:17:31,013 [I] Checking connection..
2026-08-09 16:17:31,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 16:17:31,279 [I] Checking connection passed.
2026-08-09 16:17:31,279 [I] --------- Verifying version history table ---------
2026-08-09 16:17:31,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 16:17:31,536 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 16:17:31,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 16:17:31,795 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 16:17:31,795 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 16:17:31,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 16:17:32.052 UTC [15295] WARNING: there is no transaction in progress
2026-08-09 16:17:32,060 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 16:17:32,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 16:17:32,302 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 16:17:32,302 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 16:17:32,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 16:17:32,555 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 16:17:32,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-nj21.c.gcp-upstream.internal','N') ;"
2026-08-09 16:17:33,058 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 16:17:33,317 [I] Table x_portal_user does not exist in database ranger
2026-08-09 16:17:33,318 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 16:17:33,566 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 16:17:33,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 16:17:33,824 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 16:17:34,089 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 16:17:34,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 16:17:34.989 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.006 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.022 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.037 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.054 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.069 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.121 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.127 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.140 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.149 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.158 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.170 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.178 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.184 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.189 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35.194 UTC [15481] WARNING: there is no transaction in progress
2026-08-09 16:17:35,724 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 16:17:35,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 16:17:35,976 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 16:17:35,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 16:17:36,239 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 16:17:36,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 16:17:36,500 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 16:17:36,500 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 16:17:36,753 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 16:17:37,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-nj21.c.gcp-upstream.internal';"
2026-08-09 16:17:37,258 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 16:17:37,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 16:17:37,496 [I] DB_PATCHES have already been applied
I20260809 16:17:37.502182 28516 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXqQsw3/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 16:17:37.502244 28516 mini_ranger.cc:193] Using host: 127.27.217.20
I20260809 16:17:37.505728 28516 mini_ranger.cc:227] Ranger admin URL: http://127.27.217.20:44087
Aug 09, 2026 4:17:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 4:17:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 4:17:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 4:17:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 4:17:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 4:17:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 4:17:38 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 16:17:38.693217 28516 mini_ranger.cc:160] Time spent starting Ranger: real 8.393s user 0.000s sys 0.009s
Aug 09, 2026 4:17:58 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 4:17:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 4:17:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 4:17:58 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 4:17:59 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 16:18:00.111812 28516 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.27.217.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.27.217.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/rangerkms_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.27.217.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/rangerkms_127.27.217.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.217.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.27.217.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.217.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/HTTP_127.27.217.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.217.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/HTTP_127.27.217.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 16:18:00 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292280, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 16:18:00.201211 28516 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 16:18:00.210681 28516 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 16:18:00.910117 28516 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 16:18:00.910187 28516 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms
I20260809 16:18:00.910205 28516 mini_ranger_kms.cc:227] Using postgres at 127.27.217.20:35171
2026-08-09 16:18:01,073 [I] DB FLAVOR :POSTGRES
2026-08-09 16:18:01,074 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 16:18:01,074 [I] Checking connection
2026-08-09 16:18:01,074 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 16:18:01,302 [I] connection success
2026-08-09 16:18:01,302 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 16:18:01,302 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 16:18:01,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 16:18:01,544 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 16:18:01,545 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 16:18:01,545 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 16:18:01,545 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.217.20:35171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 16:18:01,797 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 16:18:02.211361 28516 mini_ranger_kms.cc:310] Created kms service
I20260809 16:18:02.381340 28516 mini_ranger_kms.cc:326] Created kudu user
I20260809 16:18:02.420171 28516 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 16:18:02 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292280, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:02.774408 28516 mini_ranger_kms.cc:384] Added ranger policy
I20260809 16:18:02.774528 28516 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXqQsw3/build/release/bin/postgresql.jar:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXqQsw3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 16:18:02.774544 28516 mini_ranger_kms.cc:240] Using host: 127.27.217.20
I20260809 16:18:02.778921 28516 mini_ranger_kms.cc:276] Ranger KMS PID: 15784
I20260809 16:18:02.778990 28516 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.27.217.20:52509
Aug 09, 2026 4:18:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 4:18:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 4:18:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 4:18:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 4:18:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 4:18:04 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 16:18:05 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786292285, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.217.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:05.253545 28516 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.052s user 0.005s sys 0.142s
I20260809 16:18:05.253633 28516 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 16:18:05.253669 28516 mini_ranger_kms.cc:401] 127.27.217.20:52509/kms/v1/keys
Aug 09 16:18:05 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292285, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.217.20@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
Aug 09 16:18:05 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292285, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.217.20@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
Aug 09 16:18:08 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:18:08.124538 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:32901
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:32901
--ranger_config_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:52509/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:08.205331 15880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:08.205530 15880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:08.205560 15880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:08.206697 15880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:08.206746 15880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:08.206765 15880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:08.206781 15880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:08.206796 15880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:08.208428 15880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
--ranger_kms_url=127.27.217.20:52509/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:32901
--ranger_config_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:32901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:08.208670 15880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:08.208873 15880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:08.213677 15892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:08.213709 15889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:08.213892 15888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:08.214181 15880 server_base.cc:1034] running on GCE node
I20260809 16:18:08.214406 15880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:08.214692 15880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:08.215864 15880 hybrid_clock.cc:648] HybridClock initialized: now 1786292288215849 us; error 33 us; skew 500 ppm
Aug 09 16:18:08 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292288, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:08.218314 15880 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:08.218763 15880 webserver.cc:460] Webserver started at http://127.27.217.62:45913/ using document root <none> and password file <none>
I20260809 16:18:08.218990 15880 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:08.219028 15880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:08.219149 15880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 16:18:08 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292288, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:08.278942 15880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "cada00d92bb54b55a6bbfd8692b6a4ed"
format_stamp: "Formatted at 2026-08-09 16:18:08 on dist-test-slave-nj21"
server_key: "1699e4450f49ae71a9fc374ec976d8d2"
server_key_iv: "317c28e46446b5bfe3f7d460e29e683a"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:08.279294 15880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "cada00d92bb54b55a6bbfd8692b6a4ed"
format_stamp: "Formatted at 2026-08-09 16:18:08 on dist-test-slave-nj21"
server_key: "1699e4450f49ae71a9fc374ec976d8d2"
server_key_iv: "317c28e46446b5bfe3f7d460e29e683a"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:08.280680 15880 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:18:08.295498 15903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:08.295735 15880 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:08.295845 15880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "cada00d92bb54b55a6bbfd8692b6a4ed"
format_stamp: "Formatted at 2026-08-09 16:18:08 on dist-test-slave-nj21"
server_key: "1699e4450f49ae71a9fc374ec976d8d2"
server_key_iv: "317c28e46446b5bfe3f7d460e29e683a"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:08.295956 15880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:08.313493 15880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:08.315284 15880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:08.315419 15880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:08.319917 15880 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:32901
I20260809 16:18:08.319983 16002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:32901 every 8 connection(s)
I20260809 16:18:08.320315 15880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:08.320959 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:08.323318 16005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Bootstrap starting.
I20260809 16:18:08.323922 16005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:08.324178 16005 log.cc:824] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:08.324790 16005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: No bootstrap required, opened a new log
I20260809 16:18:08.326789 16005 raft_consensus.cc:348] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } }
I20260809 16:18:08.326928 16005 raft_consensus.cc:374] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:08.326949 16005 raft_consensus.cc:729] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cada00d92bb54b55a6bbfd8692b6a4ed, State: Initialized, Role: FOLLOWER
I20260809 16:18:08.327069 16005 consensus_queue.cc:260] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } }
I20260809 16:18:08.327136 16005 raft_consensus.cc:388] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:18:08.327159 16005 raft_consensus.cc:482] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:18:08.327201 16005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:08.327760 16005 raft_consensus.cc:504] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } }
I20260809 16:18:08.327847 16005 leader_election.cc:302] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cada00d92bb54b55a6bbfd8692b6a4ed; no voters:
I20260809 16:18:08.327988 16005 leader_election.cc:288] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:18:08.328013 16008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:08.328167 16008 raft_consensus.cc:686] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 1 LEADER]: Becoming Leader. State: Replica: cada00d92bb54b55a6bbfd8692b6a4ed, State: Running, Role: LEADER
I20260809 16:18:08.328251 16005 sys_catalog.cc:564] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:08.328305 16008 consensus_queue.cc:237] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } }
I20260809 16:18:08.328661 16008 sys_catalog.cc:455] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader cada00d92bb54b55a6bbfd8692b6a4ed. Latest consensus state: current_term: 1 leader_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } } }
I20260809 16:18:08.328913 16008 sys_catalog.cc:458] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:08.329293 16023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:08.329802 16023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:08.330060 16005 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 16:18:08.330088 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 15880
I20260809 16:18:08.330186 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:18:08.330358 28516 external_mini_cluster.cc:1428] Setting key 3cb3ce6f2563845b83d61d64e35cf2f8
I20260809 16:18:08.328850 16013 sys_catalog.cc:455] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } } }
I20260809 16:18:08.330446 16013 sys_catalog.cc:458] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:08.335597 16023 catalog_manager.cc:1347] Generated new cluster ID: 70d02fd4be484c498a368fb46a44a59a
I20260809 16:18:08.335698 16023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:18:08.344277 16023 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:18:08.344980 16023 catalog_manager.cc:1504] Loading token signing keys...
Aug 09 16:18:08 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:08.356803 16043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:08.333030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60776 (local address 127.27.217.62:32901)
0809 16:18:08.339783 (+ 6753us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:08.339793 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:08.339827 (+ 34us) server_negotiation.cc:407] Connection header received
0809 16:18:08.339961 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:08.339968 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:08.340022 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:08.340899 (+ 877us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:08.341008 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:08.342427 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:08.348796 (+ 6369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:08.349418 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:08.352390 (+ 2972us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:08.352483 (+ 93us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:08.352486 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:08.352487 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:08.352496 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:08.354412 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:08.354809 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:08.354812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:08.354812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:08.354909 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:08.355092 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:08.355093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:08.355093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:08.355353 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:08.356356 (+ 1003us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:08.356432 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 16:18:08.356584 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6694,"thread_start_us":180,"threads_started":1}
I20260809 16:18:08.358246 16023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Generated new TSK 0
I20260809 16:18:08.358453 16023 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:18:09.119119 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:52509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:32901
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:09.228124 16074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:09.228377 16074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:09.228410 16074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:09.229600 16074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:09.229696 16074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:09.229740 16074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:18:09.231552 16074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.27.217.20:52509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:09.231822 16074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:09.232038 16074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:09.237905 16088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:09.238150 16094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:09.238281 16090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:09.238850 16074 server_base.cc:1034] running on GCE node
I20260809 16:18:09.239063 16074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:09.239377 16074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:09.242677 16074 hybrid_clock.cc:648] HybridClock initialized: now 1786292289242648 us; error 39 us; skew 500 ppm
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:09.245397 16074 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:18:09.245826 16074 webserver.cc:460] Webserver started at http://127.27.217.1:42295/ using document root <none> and password file <none>
I20260809 16:18:09.246068 16074 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:09.246117 16074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:09.246245 16074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:09.261679 16074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "75aa8760f8804c7a9a39e9a8071cd880"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "bf40a4c6034b418f90d5760d92940a33"
server_key_iv: "c3ba8de5e09282dce548db5bbdbcef5d"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.262138 16074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "75aa8760f8804c7a9a39e9a8071cd880"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "bf40a4c6034b418f90d5760d92940a33"
server_key_iv: "c3ba8de5e09282dce548db5bbdbcef5d"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.265161 16074 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 16:18:09.286715 16108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.286949 16074 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:09.287043 16074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "75aa8760f8804c7a9a39e9a8071cd880"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "bf40a4c6034b418f90d5760d92940a33"
server_key_iv: "c3ba8de5e09282dce548db5bbdbcef5d"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.287125 16074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:09.298425 16074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:09.300818 16074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:09.301033 16074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:09.301303 16074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:09.301716 16074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:09.301810 16074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.301925 16074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:09.302008 16074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.308374 16074 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:43875
I20260809 16:18:09.308831 16074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:18:09.310389 16307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:43875 every 8 connection(s)
I20260809 16:18:09.316061 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 16074
I20260809 16:18:09.316162 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:18:09.316342 28516 external_mini_cluster.cc:1428] Setting key 956a8eec29616ba5baff5c27b8be2019
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:09.320932 16316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:09.310135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:32901 (local address 127.27.217.1:41357)
0809 16:18:09.310714 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:09.310767 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:09.311376 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:09.311761 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:09.311765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:09.312002 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:09.312269 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:09.312275 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.313307 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.313308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:09.314573 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:09.314576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.315137 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.315138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:09.315282 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:09.315846 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:09.315856 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:09.317478 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:09.319379 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:09.319386 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:09.319388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:09.319662 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:09.319904 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:09.319905 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:09.319905 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:09.320027 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:09.320298 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:09.320305 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:09.320456 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 16:18:09.320555 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 16:18:09.320700 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":90,"threads_started":1}
I20260809 16:18:09.321537 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:09.309933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:41357 (local address 127.27.217.62:32901)
0809 16:18:09.310654 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:09.310657 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:09.311506 (+ 849us) server_negotiation.cc:407] Connection header received
0809 16:18:09.311536 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:09.311537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:09.311550 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:09.311611 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:09.312379 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.313202 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.314669 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.314996 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.315056 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:09.317578 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:09.317580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:09.317580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:09.317587 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:09.319289 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:09.319768 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:09.319770 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:09.319770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:09.319837 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:09.320092 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:09.320093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:09.320094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:09.320216 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:09.320273 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:09.321366 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0809 16:18:09.321451 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":84,"threads_started":1}
I20260809 16:18:09.322263 16310 heartbeater.cc:347] Connected to a master server at 127.27.217.62:32901
I20260809 16:18:09.322351 16310 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:09.322520 16310 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:09.323050 15937 ts_manager.cc:194] Registered new tserver with Master: 75aa8760f8804c7a9a39e9a8071cd880 (127.27.217.1:43875)
I20260809 16:18:09.323939 15937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:41357
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:18:09.356065 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:52509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:32901
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 16:18:09.446396 16323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:09.446753 16323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:09.446842 16323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:09.448552 16323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:09.448654 16323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:09.448750 16323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:18:09.450682 16323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.27.217.20:52509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:09.451112 16323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:09.451421 16323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:09.456763 16331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:09.457002 16334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:09.457113 16330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:09.458045 16323 server_base.cc:1034] running on GCE node
I20260809 16:18:09.458359 16323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:09.458608 16323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:09.461836 16323 hybrid_clock.cc:648] HybridClock initialized: now 1786292289461809 us; error 36 us; skew 500 ppm
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:09.464254 16323 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:18:09.464636 16323 webserver.cc:460] Webserver started at http://127.27.217.2:35339/ using document root <none> and password file <none>
I20260809 16:18:09.464875 16323 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:09.464922 16323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:09.465037 16323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:09.475561 16323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "d3a35b8025214142b00a26cffa5622f0"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "de9a3438dfb7db7a9aefa65f4d195016"
server_key_iv: "ab3772768ca0338fa4f53d8cf6a63d80"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.481298 16323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "d3a35b8025214142b00a26cffa5622f0"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "de9a3438dfb7db7a9aefa65f4d195016"
server_key_iv: "ab3772768ca0338fa4f53d8cf6a63d80"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.483263 16323 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:09.499933 16347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.500170 16323 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 16:18:09.500264 16323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "d3a35b8025214142b00a26cffa5622f0"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "de9a3438dfb7db7a9aefa65f4d195016"
server_key_iv: "ab3772768ca0338fa4f53d8cf6a63d80"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.500344 16323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:09.514168 16323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:09.516477 16323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:09.516664 16323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:09.516925 16323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:09.517313 16323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:09.517397 16323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.517469 16323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:09.517536 16323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.525870 16323 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:43773
I20260809 16:18:09.526350 16323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:18:09.526906 16543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:43773 every 8 connection(s)
I20260809 16:18:09.531729 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 16323
I20260809 16:18:09.531831 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:18:09.532025 28516 external_mini_cluster.cc:1428] Setting key f4b01e12f59df150b0c58c7567337a3c
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:09.538115 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:09.527639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45581 (local address 127.27.217.62:32901)
0809 16:18:09.527707 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:09.527709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:09.528232 (+ 523us) server_negotiation.cc:407] Connection header received
0809 16:18:09.528912 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:09.528913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:09.528930 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:09.528960 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:09.529819 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.530561 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.532001 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.532306 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.532350 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:09.534844 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:09.534846 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:09.534846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:09.534854 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:09.536464 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:09.536939 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:09.536941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:09.536941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:09.537015 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:09.537338 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:09.537340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:09.537340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:09.537484 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:09.537532 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:09.537933 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 16:18:09.538023 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:18:09.538834 16549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:09.527816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:32901 (local address 127.27.217.2:45581)
0809 16:18:09.528110 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:09.528152 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:09.528786 (+ 634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:09.529135 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:09.529139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:09.529406 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:09.529702 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:09.529709 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.530678 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.530679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:09.531901 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:09.531904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.532453 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.532454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:09.532589 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:09.533149 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:09.533159 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:09.534738 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:09.536559 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:09.536565 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:09.536567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:09.536836 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:09.537100 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:09.537100 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:09.537101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:09.537245 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:09.537584 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:09.537590 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:09.537750 (+ 160us) client_negotiation.cc:769] Sending connection context
0809 16:18:09.538448 (+ 698us) client_negotiation.cc:240] Negotiation successful
0809 16:18:09.538609 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":94,"threads_started":1}
I20260809 16:18:09.539279 16544 heartbeater.cc:347] Connected to a master server at 127.27.217.62:32901
I20260809 16:18:09.539379 16544 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:09.539567 16544 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:09.539970 15937 ts_manager.cc:194] Registered new tserver with Master: d3a35b8025214142b00a26cffa5622f0 (127.27.217.2:43773)
I20260809 16:18:09.540436 15937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:45581
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:18:09.568599 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:52509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:32901
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:09.689426 16558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:09.689766 16558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:09.689848 16558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:09.691704 16558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:09.691817 16558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:09.691936 16558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:18:09.694072 16558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.27.217.20:52509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:09.694684 16558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:09.694995 16558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:09.704038 16565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:09.704038 16563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:09.704399 16569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:09.705521 16558 server_base.cc:1034] running on GCE node
I20260809 16:18:09.705729 16558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:09.705979 16558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:09.722332 16558 hybrid_clock.cc:648] HybridClock initialized: now 1786292289722298 us; error 44 us; skew 500 ppm
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:09.726082 16558 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:18:09.726651 16558 webserver.cc:460] Webserver started at http://127.27.217.3:46217/ using document root <none> and password file <none>
I20260809 16:18:09.726985 16558 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:09.727094 16558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:09.727255 16558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:09.749524 16558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "183c6bd48a944d798e173686c8e5702d"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "df496f5aa1799427ecac270028f14b0e"
server_key_iv: "68d5b39d8159d909a39a4835284f30a6"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.750079 16558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "183c6bd48a944d798e173686c8e5702d"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "df496f5aa1799427ecac270028f14b0e"
server_key_iv: "68d5b39d8159d909a39a4835284f30a6"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.757351 16558 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.002s
I20260809 16:18:09.773224 16581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.773409 16558 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260809 16:18:09.773504 16558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "183c6bd48a944d798e173686c8e5702d"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "df496f5aa1799427ecac270028f14b0e"
server_key_iv: "68d5b39d8159d909a39a4835284f30a6"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:09.773588 16558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:09.796741 16558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:09.807092 16558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:09.807240 16558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:09.807478 16558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:09.807868 16558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:09.807914 16558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.807942 16558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:09.807963 16558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:09.814867 16558 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:37619
I20260809 16:18:09.815264 16558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:18:09.818444 16768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:37619 every 8 connection(s)
I20260809 16:18:09.822439 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 16558
I20260809 16:18:09.822533 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:18:09.822731 28516 external_mini_cluster.cc:1428] Setting key f56345708b53be0dc6860d2a02db6124
Aug 09 16:18:09 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292289, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:09.831355 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:09.819409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:56283 (local address 127.27.217.62:32901)
0809 16:18:09.819454 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:09.819456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:09.819798 (+ 342us) server_negotiation.cc:407] Connection header received
0809 16:18:09.820505 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:09.820506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:09.820518 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:09.820549 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:09.821409 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.822194 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.825130 (+ 2936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.825432 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.825485 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:09.828125 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:09.828127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:09.828127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:09.828135 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:09.829796 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:09.830280 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:09.830282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:09.830282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:09.830341 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:09.830622 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:09.830623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:09.830623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:09.830755 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:09.830805 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:09.831175 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 16:18:09.831259 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:18:09.832136 16779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:09.819125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:32901 (local address 127.27.217.3:56283)
0809 16:18:09.819641 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:09.819704 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:09.820377 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:09.820742 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:09.820746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:09.820999 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:09.821293 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:09.821301 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.823728 (+ 2427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.823729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:09.825026 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:09.825029 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:09.825594 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:09.825595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:09.825733 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:09.826332 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:09.826341 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:09.828017 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:09.829901 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:09.829907 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:09.829909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:09.830192 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:09.830411 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:09.830412 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:09.830412 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:09.830543 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:09.830836 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:09.830854 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:09.831014 (+ 160us) client_negotiation.cc:769] Sending connection context
0809 16:18:09.831719 (+ 705us) client_negotiation.cc:240] Negotiation successful
0809 16:18:09.831897 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":82,"threads_started":1}
I20260809 16:18:09.832819 16774 heartbeater.cc:347] Connected to a master server at 127.27.217.62:32901
I20260809 16:18:09.832924 16774 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:09.833107 16774 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:09.833525 15937 ts_manager.cc:194] Registered new tserver with Master: 183c6bd48a944d798e173686c8e5702d (127.27.217.3:37619)
I20260809 16:18:09.834052 15937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:56283
I20260809 16:18:09.835700 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:18:09.836514 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 16074
I20260809 16:18:09.849383 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 16323
I20260809 16:18:09.857759 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 16558
I20260809 16:18:09.875428 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 15880
I20260809 16:18:09.891502 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:32901
--webserver_interface=127.27.217.62
--webserver_port=45913
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:32901
--ranger_config_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:52509/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.217.20:52509/kms with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:10.005913 16782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:10.006158 16782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:10.006187 16782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:10.007807 16782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:10.007854 16782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:10.007872 16782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:10.007889 16782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:10.007910 16782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:10.010083 16782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.217.20:52509/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:32901
--ranger_config_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:32901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=45913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:10.010316 16782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:10.010545 16782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:10.015172 16792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:10.015388 16782 server_base.cc:1034] running on GCE node
W20260809 16:18:10.015196 16789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:10.015172 16788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:10.015722 16782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:10.016052 16782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:10.017230 16782 hybrid_clock.cc:648] HybridClock initialized: now 1786292290017210 us; error 33 us; skew 500 ppm
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:10.020164 16782 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:10.020665 16782 webserver.cc:460] Webserver started at http://127.27.217.62:45913/ using document root <none> and password file <none>
I20260809 16:18:10.020905 16782 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:10.020978 16782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:10.061268 16782 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:10.062126 16808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.062322 16782 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:10.062419 16782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "cada00d92bb54b55a6bbfd8692b6a4ed"
format_stamp: "Formatted at 2026-08-09 16:18:08 on dist-test-slave-nj21"
server_key: "1699e4450f49ae71a9fc374ec976d8d2"
server_key_iv: "317c28e46446b5bfe3f7d460e29e683a"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:10.062775 16782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:10.095504 16782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:10.097363 16782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:10.097488 16782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:10.102092 16782 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:32901
I20260809 16:18:10.102205 16894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:32901 every 8 connection(s)
I20260809 16:18:10.102654 16782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:10.104270 16895 sys_catalog.cc:263] Verifying existing consensus state
I20260809 16:18:10.105106 16895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Bootstrap starting.
I20260809 16:18:10.108479 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 16782
I20260809 16:18:10.108745 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:52509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:43875
--local_ip_for_outbound_sockets=127.27.217.1
--tserver_master_addrs=127.27.217.62:32901
--webserver_port=42295
--webserver_interface=127.27.217.1
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.217.20:52509/kms with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:10.115537 16895 log.cc:824] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:10.117739 16895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:18:10.118036 16895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Bootstrap complete.
I20260809 16:18:10.121393 16895 raft_consensus.cc:348] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } }
I20260809 16:18:10.121701 16895 raft_consensus.cc:729] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cada00d92bb54b55a6bbfd8692b6a4ed, State: Initialized, Role: FOLLOWER
I20260809 16:18:10.121903 16895 consensus_queue.cc:260] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } }
I20260809 16:18:10.121968 16895 raft_consensus.cc:388] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:18:10.122006 16895 raft_consensus.cc:482] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:18:10.122041 16895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 1 FOLLOWER]: Advancing to term 2
I20260809 16:18:10.123335 16895 raft_consensus.cc:504] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } }
I20260809 16:18:10.123457 16895 leader_election.cc:302] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cada00d92bb54b55a6bbfd8692b6a4ed; no voters:
I20260809 16:18:10.123633 16895 leader_election.cc:288] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 16:18:10.123757 16900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 2 FOLLOWER]: Leader election won for term 2
I20260809 16:18:10.123934 16895 sys_catalog.cc:564] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:10.123942 16900 raft_consensus.cc:686] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [term 2 LEADER]: Becoming Leader. State: Replica: cada00d92bb54b55a6bbfd8692b6a4ed, State: Running, Role: LEADER
I20260809 16:18:10.124071 16900 consensus_queue.cc:237] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } }
I20260809 16:18:10.124302 16900 sys_catalog.cc:455] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader cada00d92bb54b55a6bbfd8692b6a4ed. Latest consensus state: current_term: 2 leader_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } } }
I20260809 16:18:10.124351 16900 sys_catalog.cc:458] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:10.124575 16902 sys_catalog.cc:455] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cada00d92bb54b55a6bbfd8692b6a4ed" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 32901 } } }
I20260809 16:18:10.124673 16902 sys_catalog.cc:458] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:10.124807 16905 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:10.125290 16905 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:10.125459 16905 catalog_manager.cc:1259] Loaded cluster ID: 70d02fd4be484c498a368fb46a44a59a
I20260809 16:18:10.125524 16905 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:18:10.125643 16895 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 16:18:10.131107 16905 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:18:10.131598 16905 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Loaded TSK: 0
I20260809 16:18:10.131877 16905 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 16:18:10.223789 16897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:10.224045 16897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:10.224077 16897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:10.225704 16897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:10.225759 16897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:10.225793 16897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:18:10.227851 16897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.217.20:52509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:43875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=42295
--tserver_master_addrs=127.27.217.62:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:10.228072 16897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:10.228317 16897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:10.237687 16956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:10.237793 16953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:10.238019 16897 server_base.cc:1034] running on GCE node
W20260809 16:18:10.238176 16954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:10.238418 16897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:10.238698 16897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:10.239862 16897 hybrid_clock.cc:648] HybridClock initialized: now 1786292290239834 us; error 42 us; skew 500 ppm
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:10.243055 16897 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:18:10.243595 16897 webserver.cc:460] Webserver started at http://127.27.217.1:42295/ using document root <none> and password file <none>
I20260809 16:18:10.243872 16897 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:10.243953 16897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:10.261309 16897 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:10.263748 16975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.263921 16897 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:10.264014 16897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "75aa8760f8804c7a9a39e9a8071cd880"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "bf40a4c6034b418f90d5760d92940a33"
server_key_iv: "c3ba8de5e09282dce548db5bbdbcef5d"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:10.264467 16897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:10.291158 16897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:10.295511 16897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:10.295701 16897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:10.295928 16897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:10.296312 16897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:10.296361 16897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.296396 16897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:10.296417 16897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.305032 16897 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:43875
I20260809 16:18:10.305102 17169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:43875 every 8 connection(s)
I20260809 16:18:10.305438 16897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:10.315426 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 16897
I20260809 16:18:10.315759 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:52509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:43773
--local_ip_for_outbound_sockets=127.27.217.2
--tserver_master_addrs=127.27.217.62:32901
--webserver_port=35339
--webserver_interface=127.27.217.2
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.217.20:52509/kms with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:10.316437 17174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:10.306195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:32901 (local address 127.27.217.1:52449)
0809 16:18:10.306452 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:10.306494 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:10.307068 (+ 574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:10.307592 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:10.307596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:10.307820 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:10.308009 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:10.308014 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.309071 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.309073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:10.309858 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:10.309860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.310429 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.310431 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:10.310550 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:10.311002 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:10.311010 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:10.312570 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:10.314543 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:10.314550 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:10.314552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:10.314833 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:10.315126 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:10.315127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:10.315127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:10.315236 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:10.315776 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:10.315783 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:10.315932 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 16:18:10.316045 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 16:18:10.316198 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":80,"threads_started":1}
I20260809 16:18:10.317028 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:10.306269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:52449 (local address 127.27.217.62:32901)
0809 16:18:10.307235 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:10.307242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:10.307270 (+ 28us) server_negotiation.cc:407] Connection header received
0809 16:18:10.307381 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:10.307385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:10.307424 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:10.307532 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:10.308123 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.308973 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.309936 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.310334 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.310439 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:10.312676 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:10.312680 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:10.312680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:10.312693 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:10.314456 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:10.314923 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:10.314927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:10.314927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:10.315036 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:10.315326 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:10.315327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:10.315328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:10.315625 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:10.315747 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:10.316707 (+ 960us) server_negotiation.cc:299] Negotiation successful
0809 16:18:10.316831 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":916,"thread_start_us":68,"threads_started":1}
I20260809 16:18:10.317942 17171 heartbeater.cc:347] Connected to a master server at 127.27.217.62:32901
I20260809 16:18:10.318027 17171 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.318202 17171 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
W20260809 16:18:10.319010 17171 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:32901 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 16:18:10.319070 17171 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.319128 17171 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:10.319433 17171 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.319499 17171 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
W20260809 16:18:10.319782 17171 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 16:18:10.435438 17177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:10.435712 17177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:10.435755 17177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:10.437394 17177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:10.437454 17177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:10.437491 17177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:18:10.439575 17177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.217.20:52509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:43773
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=35339
--tserver_master_addrs=127.27.217.62:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:10.439845 17177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:10.440109 17177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:10.445959 17183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:10.446640 17184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:10.447104 17177 server_base.cc:1034] running on GCE node
W20260809 16:18:10.452200 17187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:10.452494 17177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:10.452786 17177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:10.453990 17177 hybrid_clock.cc:648] HybridClock initialized: now 1786292290453977 us; error 29 us; skew 500 ppm
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:10.457192 17177 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:18:10.457780 17177 webserver.cc:460] Webserver started at http://127.27.217.2:35339/ using document root <none> and password file <none>
I20260809 16:18:10.458069 17177 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:10.458155 17177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:10.487848 17177 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260809 16:18:10.488552 17202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.488771 17177 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:10.488870 17177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "d3a35b8025214142b00a26cffa5622f0"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "de9a3438dfb7db7a9aefa65f4d195016"
server_key_iv: "ab3772768ca0338fa4f53d8cf6a63d80"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:10.489244 17177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:10.508970 17177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:10.511037 17177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:10.511214 17177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:10.511518 17177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:10.511950 17177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:10.512003 17177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.512032 17177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:10.512058 17177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.519347 17177 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:43773
I20260809 16:18:10.519415 17391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:43773 every 8 connection(s)
I20260809 16:18:10.519879 17177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:18:10.523057 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 17177
I20260809 16:18:10.523355 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.217.20:52509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:37619
--local_ip_for_outbound_sockets=127.27.217.3
--tserver_master_addrs=127.27.217.62:32901
--webserver_port=46217
--webserver_interface=127.27.217.3
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.217.20:52509/kms with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:10.530124 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:10.520687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:59247 (local address 127.27.217.62:32901)
0809 16:18:10.520740 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:10.520742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:10.520952 (+ 210us) server_negotiation.cc:407] Connection header received
0809 16:18:10.521451 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:10.521452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:10.521468 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:10.521519 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:10.522040 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.522537 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.523903 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.524213 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.524300 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:10.526898 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:10.526899 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:10.526900 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:10.526908 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:10.528560 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:10.529023 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:10.529024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:10.529025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:10.529088 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:10.529387 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:10.529388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:10.529388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:10.529543 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:10.529611 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:10.529936 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 16:18:10.530028 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 16:18:10.530579 17397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:10.520684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:32901 (local address 127.27.217.2:59247)
0809 16:18:10.520839 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:10.520875 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:10.521352 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:10.521586 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:10.521590 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:10.521759 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:10.521947 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:10.521951 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.522616 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.522617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:10.523826 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:10.523829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.524322 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.524323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:10.524460 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:10.525033 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:10.525043 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:10.526792 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:10.528646 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:10.528653 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:10.528655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:10.528940 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:10.529159 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:10.529160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:10.529160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:10.529295 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:10.529609 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:10.529615 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:10.529778 (+ 163us) client_negotiation.cc:769] Sending connection context
0809 16:18:10.529897 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 16:18:10.530051 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260809 16:18:10.531081 17392 heartbeater.cc:347] Connected to a master server at 127.27.217.62:32901
I20260809 16:18:10.531177 17392 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.531381 17392 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
W20260809 16:18:10.532671 17392 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:32901 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 16:18:10.532743 17392 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.532806 17392 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:10.533134 17392 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.533200 17392 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
W20260809 16:18:10.533497 17392 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 16:18:10.620158 17398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:10.620415 17398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:10.620462 17398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:10.622052 17398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:10.622114 17398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:10.622152 17398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:18:10.624334 17398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.217.20:52509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:37619
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=46217
--tserver_master_addrs=127.27.217.62:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:10.624621 17398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:10.624881 17398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:10.630262 17410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:10.630303 17408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:10.630448 17413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:10.630760 17398 server_base.cc:1034] running on GCE node
I20260809 16:18:10.630940 17398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:10.631145 17398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:10.632287 17398 hybrid_clock.cc:648] HybridClock initialized: now 1786292290632272 us; error 29 us; skew 500 ppm
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:10.634809 17398 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:18:10.635238 17398 webserver.cc:460] Webserver started at http://127.27.217.3:46217/ using document root <none> and password file <none>
I20260809 16:18:10.635461 17398 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:10.635521 17398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:10.659076 17398 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:10.660097 17426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.660272 17398 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 16:18:10.660368 17398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "183c6bd48a944d798e173686c8e5702d"
format_stamp: "Formatted at 2026-08-09 16:18:09 on dist-test-slave-nj21"
server_key: "df496f5aa1799427ecac270028f14b0e"
server_key_iv: "68d5b39d8159d909a39a4835284f30a6"
server_key_version: "kuduclusterkey@0"
I20260809 16:18:10.660714 17398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:10.677032 17398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:10.679927 17398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:10.680089 17398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:10.680328 17398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:10.680648 17398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:10.680689 17398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.680734 17398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:10.680761 17398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:10.687536 17398 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:37619
I20260809 16:18:10.687697 17611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:37619 every 8 connection(s)
I20260809 16:18:10.687994 17398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:18:10 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:10.697114 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 17398
I20260809 16:18:10.698671 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:10.688902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:53055 (local address 127.27.217.62:32901)
0809 16:18:10.688974 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:10.688976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:10.689144 (+ 168us) server_negotiation.cc:407] Connection header received
0809 16:18:10.689645 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:10.689647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:10.689659 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:10.689736 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:10.690311 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.691057 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.692305 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.692508 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.692574 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:10.695301 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:10.695303 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:10.695303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:10.695313 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:10.696997 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:10.697516 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:10.697517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:10.697517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:10.697589 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:10.697914 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:10.697915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:10.697916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:10.698067 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:10.698137 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:10.698475 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 16:18:10.698576 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 16:18:10.699592 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:10.688837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:32901 (local address 127.27.217.3:53055)
0809 16:18:10.689009 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:10.689051 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:10.689545 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:10.689810 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:10.689813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:10.689993 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:10.690193 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:10.690196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.691170 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.691171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:10.692220 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:10.692224 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.692600 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.692602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:10.692742 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:10.693285 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:10.693295 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:10.695195 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:10.697102 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:10.697110 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:10.697112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:10.697411 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:10.697672 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:10.697673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:10.697673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:10.697827 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:10.698167 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:10.698174 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:10.698327 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 16:18:10.699036 (+ 709us) client_negotiation.cc:240] Negotiation successful
0809 16:18:10.699357 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260809 16:18:10.700322 17612 heartbeater.cc:347] Connected to a master server at 127.27.217.62:32901
I20260809 16:18:10.700409 17612 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.700590 17612 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
W20260809 16:18:10.701313 17612 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:32901 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 16:18:10.701378 17612 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.701436 17612 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:10.701826 17612 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:10.701894 17612 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
W20260809 16:18:10.702755 17612 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 16:18:10.706745 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:10.698901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60790 (local address 127.27.217.62:32901)
0809 16:18:10.699009 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:10.699010 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:10.699101 (+ 91us) server_negotiation.cc:407] Connection header received
0809 16:18:10.699174 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:10.699175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:10.699184 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:10.699241 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:10.701956 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.702405 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.703238 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:10.703423 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:10.703476 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:10.704550 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:10.704551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:10.704552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:10.704558 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:10.705777 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:10.706066 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:10.706068 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:10.706068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:10.706120 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:10.706285 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:10.706286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:10.706287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:10.706390 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:10.706545 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:10.706580 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 16:18:10.706645 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":55,"threads_started":1}
Aug 09 16:18:11 dist-test-slave-nj21 krb5kdc[15098](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786292291, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:11.319944 17171 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:11.320093 17171 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:11.320526 16836 ts_manager.cc:194] Registered new tserver with Master: 75aa8760f8804c7a9a39e9a8071cd880 (127.27.217.1:43875)
I20260809 16:18:11.321568 16836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:52449
I20260809 16:18:11.533666 17392 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:11.533818 17392 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:11.541178 16836 ts_manager.cc:194] Registered new tserver with Master: d3a35b8025214142b00a26cffa5622f0 (127.27.217.2:43773)
I20260809 16:18:11.541718 16836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:59247
Aug 09 16:18:11 dist-test-slave-nj21 krb5kdc[15098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292291, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for HTTP/127.27.217.20@KRBTEST.COM
I20260809 16:18:11.702960 17612 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:11.703115 17612 heartbeater.cc:511] Master 127.27.217.62:32901 requested a full tablet report, sending...
I20260809 16:18:11.703397 16836 ts_manager.cc:194] Registered new tserver with Master: 183c6bd48a944d798e173686c8e5702d (127.27.217.3:37619)
I20260809 16:18:11.703989 16836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:53055
I20260809 16:18:11.704322 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:18:11.716840 17650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.705274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60804 (local address 127.27.217.62:32901)
0809 16:18:11.705398 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:11.705400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:11.705450 (+ 50us) server_negotiation.cc:407] Connection header received
0809 16:18:11.705525 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:11.705526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:11.705539 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:11.705613 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:11.706267 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.707051 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.708086 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.708385 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.708465 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.713766 (+ 5301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:11.713767 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:11.713767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:11.713776 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:11.715555 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:11.715964 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:11.715965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:11.715965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:11.716036 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:11.716254 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:11.716255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:11.716256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:11.716396 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:11.716499 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:11.716639 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 16:18:11.716732 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260809 16:18:11.718914 16836 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:18:11.721470 16836 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:18:11.729769 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.724822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45604 (local address 127.27.217.2:43773)
0809 16:18:11.724985 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:11.724989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:11.725321 (+ 332us) server_negotiation.cc:407] Connection header received
0809 16:18:11.725470 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:11.725472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:11.725488 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:11.725575 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:11.725825 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.726914 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.728466 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.729213 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.729260 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.729314 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:11.729645 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 16:18:11.729687 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260809 16:18:11.730227 17662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.724582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:43773 (local address 127.0.0.1:45604)
0809 16:18:11.725219 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:11.725257 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:11.725369 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:11.725682 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:11.725685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:11.725687 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:11.725748 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.725749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.727014 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.727015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.728368 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.728371 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.729383 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.729384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.729503 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.729534 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 16:18:11.730083 (+ 549us) client_negotiation.cc:240] Negotiation successful
0809 16:18:11.730149 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":93,"threads_started":1}
I20260809 16:18:11.731104 17279 tablet_service.cc:1467] Processing CreateTablet for tablet 9f25fd3644054fa2849dec175c38f5ad (DEFAULT_TABLE table=test-table [id=4104c16964e54e2a886438d29648ac23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:11.731499 17279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f25fd3644054fa2849dec175c38f5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:11.734493 17662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.725086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:37619 (local address 127.0.0.1:47524)
0809 16:18:11.730459 (+ 5373us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:11.730468 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:11.730513 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:11.730785 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:11.730786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:11.730787 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:11.730815 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.730816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.732224 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.732225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.733289 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.733292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.734264 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.734265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.734324 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.734327 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:18:11.734383 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 16:18:11.734424 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5362,"thread_start_us":70,"threads_started":1}
I20260809 16:18:11.734840 17667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.725149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47524 (local address 127.27.217.3:37619)
0809 16:18:11.726344 (+ 1195us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:11.726348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:11.730571 (+ 4223us) server_negotiation.cc:407] Connection header received
0809 16:18:11.730608 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:11.730611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:11.730626 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:11.730694 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:11.730894 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.732136 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.733392 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.734116 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.734181 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.734232 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:11.734717 (+ 485us) server_negotiation.cc:299] Negotiation successful
0809 16:18:11.734761 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1163,"thread_start_us":63,"threads_started":1}
I20260809 16:18:11.735602 17657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.724582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:43875 (local address 127.0.0.1:51834)
0809 16:18:11.725527 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:11.725537 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:11.725585 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:11.726171 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:11.726172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:11.726174 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:11.726229 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.726231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.727828 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.727829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.728919 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.728922 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.730261 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.730262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.730327 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.730332 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:18:11.730359 (+ 27us) client_negotiation.cc:240] Negotiation successful
0809 16:18:11.730398 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"mutex_wait_us":4,"thread_start_us":83,"threads_started":1}
I20260809 16:18:11.735708 17508 tablet_service.cc:1467] Processing CreateTablet for tablet 9f25fd3644054fa2849dec175c38f5ad (DEFAULT_TABLE table=test-table [id=4104c16964e54e2a886438d29648ac23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:11.735985 17658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.724769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51834 (local address 127.27.217.1:43875)
0809 16:18:11.725707 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:11.725711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:11.725721 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:18:11.725756 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:11.725758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:11.725772 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:11.726077 (+ 305us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:11.726385 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.727731 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.729023 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.730165 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.735755 (+ 5590us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.735822 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:11.735861 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 16:18:11.735905 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":904,"thread_start_us":56,"threads_started":1}
I20260809 16:18:11.736052 17508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f25fd3644054fa2849dec175c38f5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:11.736626 17058 tablet_service.cc:1467] Processing CreateTablet for tablet 9f25fd3644054fa2849dec175c38f5ad (DEFAULT_TABLE table=test-table [id=4104c16964e54e2a886438d29648ac23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:11.736963 17058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f25fd3644054fa2849dec175c38f5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:11.738359 17674 tablet_bootstrap.cc:492] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: Bootstrap starting.
I20260809 16:18:11.739341 17674 tablet_bootstrap.cc:654] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:11.739637 17674 log.cc:824] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:11.740240 17676 tablet_bootstrap.cc:492] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880: Bootstrap starting.
I20260809 16:18:11.740823 17676 tablet_bootstrap.cc:654] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:11.741140 17676 log.cc:824] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:11.741977 17676 tablet_bootstrap.cc:492] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880: No bootstrap required, opened a new log
I20260809 16:18:11.742051 17676 ts_tablet_manager.cc:1397] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:11.744699 17676 raft_consensus.cc:348] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.744872 17676 raft_consensus.cc:374] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:11.744906 17676 raft_consensus.cc:729] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75aa8760f8804c7a9a39e9a8071cd880, State: Initialized, Role: FOLLOWER
I20260809 16:18:11.745039 17676 consensus_queue.cc:260] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.745275 17676 ts_tablet_manager.cc:1428] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:18:11.745393 17171 heartbeater.cc:503] Master 127.27.217.62:32901 was elected leader, sending a full tablet report...
I20260809 16:18:11.747833 17669 tablet_bootstrap.cc:492] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0: Bootstrap starting.
I20260809 16:18:11.748468 17674 tablet_bootstrap.cc:492] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: No bootstrap required, opened a new log
I20260809 16:18:11.748474 17669 tablet_bootstrap.cc:654] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:11.748543 17674 ts_tablet_manager.cc:1397] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260809 16:18:11.748759 17669 log.cc:824] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:11.749570 17669 tablet_bootstrap.cc:492] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0: No bootstrap required, opened a new log
I20260809 16:18:11.749639 17669 ts_tablet_manager.cc:1397] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:11.750982 17674 raft_consensus.cc:348] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.751145 17674 raft_consensus.cc:374] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:11.751179 17674 raft_consensus.cc:729] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183c6bd48a944d798e173686c8e5702d, State: Initialized, Role: FOLLOWER
I20260809 16:18:11.751289 17674 consensus_queue.cc:260] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.751543 17674 ts_tablet_manager.cc:1428] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:18:11.751575 17612 heartbeater.cc:503] Master 127.27.217.62:32901 was elected leader, sending a full tablet report...
I20260809 16:18:11.752202 17669 raft_consensus.cc:348] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.752358 17669 raft_consensus.cc:374] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:11.752408 17669 raft_consensus.cc:729] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a35b8025214142b00a26cffa5622f0, State: Initialized, Role: FOLLOWER
I20260809 16:18:11.752535 17669 consensus_queue.cc:260] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.752774 17669 ts_tablet_manager.cc:1428] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:18:11.752818 17392 heartbeater.cc:503] Master 127.27.217.62:32901 was elected leader, sending a full tablet report...
W20260809 16:18:11.771179 17396 tablet.cc:2369] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:18:11.773805 17688 raft_consensus.cc:482] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:11.774025 17688 raft_consensus.cc:504] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.774930 17688 leader_election.cc:288] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75aa8760f8804c7a9a39e9a8071cd880 (127.27.217.1:43875), 183c6bd48a944d798e173686c8e5702d (127.27.217.3:37619)
I20260809 16:18:11.779991 17658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.774873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:40217 (local address 127.27.217.1:43875)
0809 16:18:11.776365 (+ 1492us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:11.776367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:11.776378 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:18:11.776406 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:11.776407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:11.776419 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:11.776510 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:11.776734 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.777514 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.778952 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.779554 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.779603 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.779614 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:11.779873 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 16:18:11.779920 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1462}
I20260809 16:18:11.780401 17689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.774661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:43875 (local address 127.27.217.2:40217)
0809 16:18:11.775790 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:11.775803 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:11.775863 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:11.776555 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:11.776557 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:11.776559 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:11.776641 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.776643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.777611 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.777611 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.778851 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.778854 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.779723 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.779724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.779793 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.779798 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:18:11.780248 (+ 450us) client_negotiation.cc:240] Negotiation successful
0809 16:18:11.780292 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1108,"thread_start_us":99,"threads_started":1}
I20260809 16:18:11.780555 17667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.776918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:38259 (local address 127.27.217.3:37619)
0809 16:18:11.776968 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:11.776970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:11.777094 (+ 124us) server_negotiation.cc:407] Connection header received
0809 16:18:11.777222 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:11.777223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:11.777234 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:11.777268 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:11.777516 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.778211 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.779549 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.780111 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.780167 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.780175 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:11.780437 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 16:18:11.780483 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:18:11.780805 17690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.776692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:37619 (local address 127.27.217.2:38259)
0809 16:18:11.777027 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:11.777037 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:11.777122 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:11.777344 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:11.777345 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:11.777347 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:11.777421 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.777423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.778327 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.778327 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.779431 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:11.779434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.780256 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.780257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:11.780341 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.780345 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:18:11.780678 (+ 333us) client_negotiation.cc:240] Negotiation successful
0809 16:18:11.780719 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":95,"threads_started":1}
I20260809 16:18:11.780802 17064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f25fd3644054fa2849dec175c38f5ad" candidate_uuid: "d3a35b8025214142b00a26cffa5622f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75aa8760f8804c7a9a39e9a8071cd880" is_pre_election: true
I20260809 16:18:11.780947 17064 raft_consensus.cc:2454] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a35b8025214142b00a26cffa5622f0 in term 0.
I20260809 16:18:11.781141 17536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f25fd3644054fa2849dec175c38f5ad" candidate_uuid: "d3a35b8025214142b00a26cffa5622f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183c6bd48a944d798e173686c8e5702d" is_pre_election: true
I20260809 16:18:11.781221 17206 leader_election.cc:302] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75aa8760f8804c7a9a39e9a8071cd880, d3a35b8025214142b00a26cffa5622f0; no voters:
I20260809 16:18:11.781314 17536 raft_consensus.cc:2454] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3a35b8025214142b00a26cffa5622f0 in term 0.
I20260809 16:18:11.781343 17688 raft_consensus.cc:2781] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:18:11.781385 17688 raft_consensus.cc:482] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:18:11.781582 17688 raft_consensus.cc:3037] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:11.782637 17688 raft_consensus.cc:504] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.782936 17064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f25fd3644054fa2849dec175c38f5ad" candidate_uuid: "d3a35b8025214142b00a26cffa5622f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75aa8760f8804c7a9a39e9a8071cd880"
I20260809 16:18:11.782982 17688 leader_election.cc:288] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [CANDIDATE]: Term 1 election: Requested vote from peers 75aa8760f8804c7a9a39e9a8071cd880 (127.27.217.1:43875), 183c6bd48a944d798e173686c8e5702d (127.27.217.3:37619)
I20260809 16:18:11.782992 17536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f25fd3644054fa2849dec175c38f5ad" candidate_uuid: "d3a35b8025214142b00a26cffa5622f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183c6bd48a944d798e173686c8e5702d"
I20260809 16:18:11.783010 17064 raft_consensus.cc:3037] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:11.783059 17536 raft_consensus.cc:3037] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:11.783769 17536 raft_consensus.cc:2454] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a35b8025214142b00a26cffa5622f0 in term 1.
I20260809 16:18:11.783874 17064 raft_consensus.cc:2454] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3a35b8025214142b00a26cffa5622f0 in term 1.
I20260809 16:18:11.783965 17204 leader_election.cc:302] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183c6bd48a944d798e173686c8e5702d, d3a35b8025214142b00a26cffa5622f0; no voters:
I20260809 16:18:11.784190 17688 raft_consensus.cc:2781] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:11.784528 17688 raft_consensus.cc:686] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [term 1 LEADER]: Becoming Leader. State: Replica: d3a35b8025214142b00a26cffa5622f0, State: Running, Role: LEADER
I20260809 16:18:11.784637 17688 consensus_queue.cc:237] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } }
I20260809 16:18:11.785523 16835 catalog_manager.cc:5495] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3a35b8025214142b00a26cffa5622f0 (127.27.217.2). New cstate: current_term: 1 leader_uuid: "d3a35b8025214142b00a26cffa5622f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3a35b8025214142b00a26cffa5622f0" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 } health_report { overall_health: UNKNOWN } } }
I20260809 16:18:11.805475 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.802073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45616 (local address 127.27.217.2:43773)
0809 16:18:11.802149 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:11.802151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:11.802163 (+ 12us) server_negotiation.cc:407] Connection header received
0809 16:18:11.802218 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:11.802219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:11.802242 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:11.802329 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:18:11.802493 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.803219 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.804412 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:11.804722 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:11.804826 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:11.805065 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:18:11.805203 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:18:11.805290 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:11.805353 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 16:18:11.805376 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 16:18:11.806903 17173 tablet.cc:2369] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:18:11.808374 17536 raft_consensus.cc:1261] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 1 FOLLOWER]: Refusing update from remote peer d3a35b8025214142b00a26cffa5622f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:11.808707 17694 consensus_queue.cc:1035] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183c6bd48a944d798e173686c8e5702d" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 37619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:11.810770 17064 raft_consensus.cc:1261] T 9f25fd3644054fa2849dec175c38f5ad P 75aa8760f8804c7a9a39e9a8071cd880 [term 1 FOLLOWER]: Refusing update from remote peer d3a35b8025214142b00a26cffa5622f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:11.811033 17694 consensus_queue.cc:1035] T 9f25fd3644054fa2849dec175c38f5ad P d3a35b8025214142b00a26cffa5622f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aa8760f8804c7a9a39e9a8071cd880" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:11.814517 17700 mvcc.cc:205] Tried to move back new op lower bound from 7316653227240624128 to 7316653227150430208. Current Snapshot: MvccSnapshot[applied={T|T < 7316653227240624128}]
I20260809 16:18:11.816175 17705 mvcc.cc:205] Tried to move back new op lower bound from 7316653227240624128 to 7316653227150430208. Current Snapshot: MvccSnapshot[applied={T|T < 7316653227240624128}]
I20260809 16:18:11.819031 16836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:11.819129 16836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:11.820058 16836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cada00d92bb54b55a6bbfd8692b6a4ed: Sending DeleteTablet for 3 replicas of tablet 9f25fd3644054fa2849dec175c38f5ad
I20260809 16:18:11.820660 17279 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f25fd3644054fa2849dec175c38f5ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:11 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:45604
I20260809 16:18:11.820874 17058 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f25fd3644054fa2849dec175c38f5ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:11 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:51834
I20260809 16:18:11.821094 17508 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f25fd3644054fa2849dec175c38f5ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:11 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:47524
I20260809 16:18:11.821658 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 16897
I20260809 16:18:11.840130 17718 tablet_replica.cc:330] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: stopping tablet replica
I20260809 16:18:11.840307 17718 raft_consensus.cc:2229] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:11.840444 17718 raft_consensus.cc:2258] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 16:18:11.840875 16811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:43875 (error 108)
I20260809 16:18:11.841071 17718 ts_tablet_manager.cc:1905] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:11.841756 17657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.841621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:43875 (local address 127.0.0.1:51840)
0809 16:18:11.841680 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:11.841718 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:43875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 16:18:11.841897 16811 catalog_manager.cc:4584] TS 75aa8760f8804c7a9a39e9a8071cd880 (127.27.217.1:43875): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9f25fd3644054fa2849dec175c38f5ad: Network error: Client connection negotiation failed: client connection to 127.27.217.1:43875: connect: Connection refused (error 111)
I20260809 16:18:11.842092 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 17177
I20260809 16:18:11.842767 17718 ts_tablet_manager.cc:1918] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:11.842856 17718 log.cc:1196] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/9f25fd3644054fa2849dec175c38f5ad
I20260809 16:18:11.843132 17718 ts_tablet_manager.cc:1939] T 9f25fd3644054fa2849dec175c38f5ad P 183c6bd48a944d798e173686c8e5702d: Deleting consensus metadata
I20260809 16:18:11.845526 16809 catalog_manager.cc:4841] TS 183c6bd48a944d798e173686c8e5702d (127.27.217.3:37619): tablet 9f25fd3644054fa2849dec175c38f5ad (table test-table [id=4104c16964e54e2a886438d29648ac23]) successfully deleted
I20260809 16:18:11.852723 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 17398
I20260809 16:18:11.860211 17657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:11.860062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:43773 (local address 127.0.0.1:45628)
0809 16:18:11.860127 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:11.860168 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.2:43773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 16:18:11.864919 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 16782
I20260809 16:18:11.876175 28516 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 16:18:12.220799 28516 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 16:18:12.220891 28516 mini_ranger.cc:66] Stopping Ranger...
I20260809 16:18:12.564194 28516 mini_ranger.cc:68] Stopped Ranger
2026-08-09 16:18:12.564 UTC [15156] LOG: received smart shutdown request
2026-08-09 16:18:12.568 UTC [15156] LOG: background worker "logical replication launcher" (PID 15169) exited with exit code 1
2026-08-09 16:18:12.569 UTC [15163] LOG: shutting down
2026-08-09 16:18:12.707 UTC [15156] LOG: database system is shut down
2026-08-09T16:18:12Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47187 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:18:12 dist-test-slave-nj21 krb5kdc[17736](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:18:12 dist-test-slave-nj21 krb5kdc[17736](info): set up 2 sockets
Aug 09 16:18:12 dist-test-slave-nj21 krb5kdc[17736](info): commencing operation
krb5kdc: starting...
W20260809 16:18:13.943257 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:18:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:18:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:18:14.053632 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:38229
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:38229,127.27.217.61:46701,127.27.217.60:38053
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:14.132262 17764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:14.132465 17764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:14.132494 17764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:14.133612 17764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:14.133652 17764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:14.133669 17764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:14.133685 17764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:14.133700 17764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:14.135174 17764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:38229,127.27.217.61:46701,127.27.217.60:38053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:38229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:14.135427 17764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:14.135637 17764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:14.140201 17777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:14.140242 17776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:14.140235 17780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:14.140362 17764 server_base.cc:1034] running on GCE node
I20260809 16:18:14.140659 17764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:14.140936 17764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:14.142081 17764 hybrid_clock.cc:648] HybridClock initialized: now 1786292294142062 us; error 35 us; skew 500 ppm
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:14.144441 17764 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:14.144822 17764 webserver.cc:460] Webserver started at http://127.27.217.62:39045/ using document root <none> and password file <none>
I20260809 16:18:14.145026 17764 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:14.145073 17764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:14.145197 17764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:14.146268 17764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "01b84731f09e4ec0bfacfd0daddbbf1d"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "1a8afaead535d943729aa5cea6b46793"
server_key_iv: "b21b7b95930b82c254fc549cbcc34fa3"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.146605 17764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "01b84731f09e4ec0bfacfd0daddbbf1d"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "1a8afaead535d943729aa5cea6b46793"
server_key_iv: "b21b7b95930b82c254fc549cbcc34fa3"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.147958 17764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:18:14.148599 17790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:14.148744 17764 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:14.148829 17764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "01b84731f09e4ec0bfacfd0daddbbf1d"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "1a8afaead535d943729aa5cea6b46793"
server_key_iv: "b21b7b95930b82c254fc549cbcc34fa3"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.148886 17764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:14.159739 17764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:14.161298 17764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:14.161429 17764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:14.165151 17764 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:38229
I20260809 16:18:14.165182 17875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:38229 every 8 connection(s)
I20260809 16:18:14.165485 17764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:14.166301 17877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:14.167620 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 17764
I20260809 16:18:14.167732 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:18:14.167918 28516 external_mini_cluster.cc:1428] Setting key 30a0d0c0ff1ff36958b08fe48c9e4db9
I20260809 16:18:14.167838 17877 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.217.61@KRBTEST.COM; defaulting to no policy
I20260809 16:18:14.177836 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.168500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:38229 (local address 127.0.0.1:38176)
0809 16:18:14.168668 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.168715 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.169257 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.169509 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.169511 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.169822 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.169976 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.169980 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.171226 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.171227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.172282 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.172286 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.172762 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.172763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.172844 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.173278 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.173287 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.174756 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.176546 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.176552 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.176553 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.176730 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.176930 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.176930 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.176930 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.176998 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.177368 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.177373 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.177435 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.177508 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.177686 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":71,"thread_start_us":67,"threads_started":1}
I20260809 16:18:14.177845 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.168651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38176 (local address 127.27.217.62:38229)
0809 16:18:14.168752 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.168757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.168786 (+ 29us) server_negotiation.cc:407] Connection header received
0809 16:18:14.169387 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.169389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.169405 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.169483 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.170058 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.171134 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.172383 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.172682 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.172758 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.174840 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.174848 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.174848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.174856 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.176476 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.176797 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.176799 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.176799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.176880 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.177070 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.177071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.177071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.177306 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.177375 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.177542 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.177633 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74,"thread_start_us":37,"threads_started":1}
I20260809 16:18:14.178539 17877 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:18:14.178826 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.178732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33846)
0809 16:18:14.178770 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.178808 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 16:18:14.178954 17797 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.61@KRBTEST.COM" created.
I20260809 16:18:14.179334 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.179242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33856)
0809 16:18:14.179283 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.179312 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 16:18:14.179458 17877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:46701: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab.
Entry for principal kudu/127.27.217.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab.
I20260809 16:18:14.192020 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.61:46701
--webserver_interface=127.27.217.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab
--principal=kudu/127.27.217.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:38229,127.27.217.61:46701,127.27.217.60:38053
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:14.228652 17877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } attempt: 1
I20260809 16:18:14.229120 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.228988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33860)
0809 16:18:14.229044 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.229087 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 16:18:14.229434 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.229346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33872)
0809 16:18:14.229386 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.229413 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:18:14.229538 17877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:46701: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
W20260809 16:18:14.270784 17888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:14.270977 17888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:14.270998 17888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:14.272115 17888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:14.272153 17888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:14.272166 17888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:14.272183 17888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:14.272207 17888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:14.273669 17888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:38229,127.27.217.61:46701,127.27.217.60:38053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab
--principal=kudu/127.27.217.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.61:46701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.217.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:14.273896 17888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:14.274098 17888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:14.278558 17902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:14.278568 17899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:14.278590 17898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:14.278792 17888 server_base.cc:1034] running on GCE node
I20260809 16:18:14.279019 17888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:14.279276 17888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:14.280416 17888 hybrid_clock.cc:648] HybridClock initialized: now 1786292294280401 us; error 27 us; skew 500 ppm
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:14.282686 17888 init.cc:377] Logged in from keytab as kudu/127.27.217.61@KRBTEST.COM (short username kudu)
I20260809 16:18:14.283070 17888 webserver.cc:460] Webserver started at http://127.27.217.61:38279/ using document root <none> and password file <none>
I20260809 16:18:14.283273 17888 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:14.283319 17888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:14.283452 17888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:14.284453 17888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/data/instance:
uuid: "ef0e8603eeed4a91b273cf8218ce4f76"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "d97015866b573477c8f2e2b4a58e8416"
server_key_iv: "f48ba2e80510a99b4de33cdb1dfcbaac"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.284780 17888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/wal/instance:
uuid: "ef0e8603eeed4a91b273cf8218ce4f76"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "d97015866b573477c8f2e2b4a58e8416"
server_key_iv: "f48ba2e80510a99b4de33cdb1dfcbaac"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.285986 17888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:18:14.286614 17918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:14.286758 17888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:18:14.286839 17888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/wal
uuid: "ef0e8603eeed4a91b273cf8218ce4f76"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "d97015866b573477c8f2e2b4a58e8416"
server_key_iv: "f48ba2e80510a99b4de33cdb1dfcbaac"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.286897 17888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:14.296895 17888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:14.297690 17877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } attempt: 2
I20260809 16:18:14.298081 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.297957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33882)
0809 16:18:14.298013 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.298050 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 16:18:14.298398 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.298330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33892)
0809 16:18:14.298349 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.298376 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9,"threads_started":1}
W20260809 16:18:14.298480 17877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:46701: Network error: Client connection negotiation failed: client connection to 127.27.217.61:46701: connect: Connection refused (error 111)
I20260809 16:18:14.298779 17888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:14.298905 17888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:14.302513 17888 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.61:46701
I20260809 16:18:14.302544 18014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.61:46701 every 8 connection(s)
I20260809 16:18:14.302840 17888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
I20260809 16:18:14.303618 18015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:14.305127 18015 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:18:14.306015 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 17888
I20260809 16:18:14.306106 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-1/wal/instance
I20260809 16:18:14.306267 28516 external_mini_cluster.cc:1428] Setting key f35a3fac417d1e5de2d8c89e8fa4ae3c
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:14.313405 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.305709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38192 (local address 127.27.217.62:38229)
0809 16:18:14.305756 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.305758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.305986 (+ 228us) server_negotiation.cc:407] Connection header received
0809 16:18:14.306494 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.306496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.306507 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.306563 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.307131 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.307603 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.308546 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.308759 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.308822 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.310742 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.310744 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.310744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.310752 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.312198 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.312553 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.312554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.312554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.312617 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.312821 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.312822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.312822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.312957 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.313026 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.313231 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.313309 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:18:14.313455 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.305701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:38229 (local address 127.0.0.1:38192)
0809 16:18:14.305878 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.305912 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.306405 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.306630 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.306634 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.306864 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.307046 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.307050 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.307700 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.307701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.308467 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.308470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.308832 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.308833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.308945 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.309347 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.309373 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.310652 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.312273 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.312279 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.312280 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.312485 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.312679 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.312679 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.312680 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.312767 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.313012 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.313015 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.313116 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.313190 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.313298 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260809 16:18:14.313990 18015 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.27.217.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.60@KRBTEST.COM" created.
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:18:14.320688 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.314212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33900)
0809 16:18:14.314258 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.314268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.314310 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.314503 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.314504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.314634 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.314694 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.314696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.315558 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.315559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.316058 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.316059 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.316515 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.316516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.316561 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.316854 (+ 293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.316858 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.317994 (+ 1136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.319756 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.319757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.319758 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.319925 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.320104 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.320104 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.320105 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.320156 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.320408 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.320409 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.320446 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.320506 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.320598 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 16:18:14.320782 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.314249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33900 (local address 127.27.217.61:46701)
0809 16:18:14.314377 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.314381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.314400 (+ 19us) server_negotiation.cc:407] Connection header received
0809 16:18:14.314420 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.314422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.314434 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.314495 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.314749 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.315493 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.316122 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.316453 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.316533 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.318068 (+ 1535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.318075 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.318075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.318081 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.319630 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.319984 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.319986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.319986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.320034 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.320203 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.320204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.320204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.320324 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.320428 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.320534 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.320666 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":96,"thread_start_us":66,"threads_started":1}
I20260809 16:18:14.321244 18015 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:18:14.321547 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.321449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60204)
0809 16:18:14.321485 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.321525 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260809 16:18:14.321681 17919 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
I20260809 16:18:14.322074 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.321996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60218)
0809 16:18:14.322035 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.322058 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 16:18:14.322172 18015 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:38053: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab.
Entry for principal kudu/127.27.217.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab.
I20260809 16:18:14.331624 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.60:38053
--webserver_interface=127.27.217.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab
--principal=kudu/127.27.217.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:38229,127.27.217.61:46701,127.27.217.60:38053
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:14.371423 18015 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } attempt: 1
I20260809 16:18:14.371917 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.371775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60226)
0809 16:18:14.371837 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.371880 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 16:18:14.372221 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.372128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60234)
0809 16:18:14.372167 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.372195 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:18:14.372321 18015 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:38053: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
I20260809 16:18:14.389601 17877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } attempt: 3
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:18:14.397119 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.390020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33904 (local address 127.27.217.61:46701)
0809 16:18:14.390074 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.390076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.390106 (+ 30us) server_negotiation.cc:407] Connection header received
0809 16:18:14.390178 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.390180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.390193 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.390255 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.390580 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.391402 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.392112 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.392436 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.392523 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.394795 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.394797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.394797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.394804 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.396101 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.396471 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.396472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.396472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.396520 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.396695 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.396695 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.396695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.396788 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.396831 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.396996 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.397055 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:18:14.397194 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.389959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33904)
0809 16:18:14.390023 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.390035 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.390118 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.390264 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.390265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.390449 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.390513 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.390515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.391474 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.391474 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.392037 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.392039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.392542 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.392543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.392593 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.393388 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.393393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.394713 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.396176 (+ 1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.396177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.396177 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.396406 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.396573 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.396574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.396574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.396642 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.396841 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.396842 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.396894 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.396983 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.397087 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 16:18:14.397605 17877 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:18:14.397930 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.397829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60248)
0809 16:18:14.397875 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.397907 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 16:18:14.398222 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.398142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60258)
0809 16:18:14.398180 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.398204 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 16:18:14.398304 17877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:38053: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
W20260809 16:18:14.411824 18023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:14.412004 18023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:14.412025 18023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:14.413079 18023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:14.413110 18023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:14.413122 18023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:14.413133 18023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:14.413151 18023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:14.414543 18023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:38229,127.27.217.61:46701,127.27.217.60:38053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab
--principal=kudu/127.27.217.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.60:38053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.217.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:14.414727 18023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:14.414899 18023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:14.419211 18029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:14.419235 18030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:14.419251 18023 server_base.cc:1034] running on GCE node
W20260809 16:18:14.419217 18033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:14.419727 18023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:14.419984 18023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:14.421113 18023 hybrid_clock.cc:648] HybridClock initialized: now 1786292294421101 us; error 26 us; skew 500 ppm
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:14.423364 18023 init.cc:377] Logged in from keytab as kudu/127.27.217.60@KRBTEST.COM (short username kudu)
I20260809 16:18:14.424079 18023 webserver.cc:460] Webserver started at http://127.27.217.60:42723/ using document root <none> and password file <none>
I20260809 16:18:14.424265 18023 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:14.424304 18023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:14.424422 18023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:14.425388 18023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/data/instance:
uuid: "37fad879eca44d05a5340ac69c6924bf"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "385e500f1b1c52dff084f715ab0a38ff"
server_key_iv: "82a50014f967ba0d6c199a39df9b3bcb"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.425670 18023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/wal/instance:
uuid: "37fad879eca44d05a5340ac69c6924bf"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "385e500f1b1c52dff084f715ab0a38ff"
server_key_iv: "82a50014f967ba0d6c199a39df9b3bcb"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.426767 18023 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:18:14.427371 18042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:14.427510 18023 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:18:14.427582 18023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/wal
uuid: "37fad879eca44d05a5340ac69c6924bf"
format_stamp: "Formatted at 2026-08-09 16:18:14 on dist-test-slave-nj21"
server_key: "385e500f1b1c52dff084f715ab0a38ff"
server_key_iv: "82a50014f967ba0d6c199a39df9b3bcb"
server_key_version: "encryptionkey@0"
I20260809 16:18:14.427631 18023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:14.429440 17877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } attempt: 1
I20260809 16:18:14.429801 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.429682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60268)
0809 16:18:14.429733 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.429769 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 16:18:14.430120 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.430031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60284)
0809 16:18:14.430070 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.430097 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:18:14.430203 17877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:38053: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
I20260809 16:18:14.440456 18015 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } attempt: 2
I20260809 16:18:14.440779 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.440660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60286)
0809 16:18:14.440713 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.440747 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 16:18:14.441072 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.440997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60288)
0809 16:18:14.441033 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.441055 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 16:18:14.441154 18015 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:38053: Network error: Client connection negotiation failed: client connection to 127.27.217.60:38053: connect: Connection refused (error 111)
I20260809 16:18:14.466281 18023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:14.467983 18023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:14.468112 18023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:14.471783 18023 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.60:38053
I20260809 16:18:14.471828 18136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.60:38053 every 8 connection(s)
I20260809 16:18:14.472147 18023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
I20260809 16:18:14.472941 18137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:14.474383 18137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:18:14.475829 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 18023
I20260809 16:18:14.475948 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786292143139430-28516-0/minicluster-data/master-2/wal/instance
I20260809 16:18:14.476102 28516 external_mini_cluster.cc:1428] Setting key 12747a25313678f5daaedd3f812012d5
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:18:14.483036 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.475016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38198 (local address 127.27.217.62:38229)
0809 16:18:14.475081 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.475083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.475235 (+ 152us) server_negotiation.cc:407] Connection header received
0809 16:18:14.475706 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.475707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.475720 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.475768 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.476477 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.477064 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.477979 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.478173 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.478229 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.480371 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.480373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.480373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.480381 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.481750 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.482168 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.482169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.482170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.482226 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.482448 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.482449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.482449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.482600 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.482670 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.482875 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.482952 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 16:18:14.483173 18140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.474951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:38229 (local address 127.0.0.1:38198)
0809 16:18:14.475129 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.475163 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.475590 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.475843 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.475846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.476133 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.476344 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.476348 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.477140 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.477141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.477898 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.477900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.478236 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.478237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.478373 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.478832 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.478848 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.480290 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.481822 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.481827 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.481829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.482100 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.482293 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.482294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.482294 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.482391 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.482658 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.482660 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.482759 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.482830 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.482959 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":81,"threads_started":1}
I20260809 16:18:14.483711 18137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:18:14.484302 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.476420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60294 (local address 127.27.217.60:38053)
0809 16:18:14.476578 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.476582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.476608 (+ 26us) server_negotiation.cc:407] Connection header received
0809 16:18:14.476652 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.476654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.476674 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.476745 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.477287 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.478018 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.478752 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.479148 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.479220 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.481362 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.481369 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.481370 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.481377 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.482878 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.483247 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.483250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.483251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.483329 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.483594 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.483594 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.483595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.483762 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.483884 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.484131 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.484201 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":101,"threads_started":1}
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:14.490197 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.484029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33918 (local address 127.27.217.61:46701)
0809 16:18:14.484087 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.484089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.484097 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:18:14.484121 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.484122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.484131 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.484181 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.484443 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.484960 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.485834 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.486135 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.486200 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.487911 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.487912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.487913 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.487920 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.489144 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.489526 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.489527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.489527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.489578 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.489755 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.489755 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.489756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.489859 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.489906 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.490037 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.490097 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:18:14.490181 18140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.483940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:46701 (local address 127.0.0.1:33918)
0809 16:18:14.483971 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.483981 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.484023 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.484195 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.484196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.484313 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.484361 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.484362 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.485070 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.485071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.485767 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.485769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.486196 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.486196 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.486242 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.486554 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.486558 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.487824 (+ 1266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.489233 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.489234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.489234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.489434 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.489638 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.489639 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.489640 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.489701 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.489904 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.489904 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.489947 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.490019 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.490097 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260809 16:18:14.490682 18137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:18:14.492285 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.485071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38202 (local address 127.27.217.62:38229)
0809 16:18:14.485108 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.485110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.485158 (+ 48us) server_negotiation.cc:407] Connection header received
0809 16:18:14.485221 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.485222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.485229 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.485263 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.485759 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.486381 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.487224 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.487515 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.487579 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.489871 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.489872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.489872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.489878 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.491294 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.491618 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.491619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.491619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.491697 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.491856 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.491857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.491857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.491954 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.492107 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.492141 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.492205 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:18:14.496315 18140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.490876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60306)
0809 16:18:14.490912 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.490920 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.490948 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.491064 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.491064 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.491181 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.491204 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.491205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.491807 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.491808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.492248 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.492249 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.492763 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.492764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.492815 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.493133 (+ 318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.493137 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.494117 (+ 980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.495485 (+ 1368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.495486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.495486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.495627 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.495798 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.495798 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.495799 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.495857 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.496045 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.496046 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.496080 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.496138 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.496226 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 16:18:14.496376 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.490945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60306 (local address 127.27.217.60:38053)
0809 16:18:14.490989 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.490991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.490997 (+ 6us) server_negotiation.cc:407] Connection header received
0809 16:18:14.491012 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.491012 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.491020 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.491062 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.491260 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.491750 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.492433 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.492692 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.492754 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.494183 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.494184 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.494184 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.494190 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.495418 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.495700 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.495701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.495701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.495748 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.495903 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.495904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.495904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.495996 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.496046 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.496162 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.496273 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":30}
I20260809 16:18:14.497786 18137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf: Bootstrap starting.
I20260809 16:18:14.498780 18137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:14.499056 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.492833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33920 (local address 127.27.217.61:46701)
0809 16:18:14.492874 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.492876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.492883 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:18:14.492902 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.492903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.492912 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.492962 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.493419 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.493876 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.494470 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.494659 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.494714 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.496649 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.496650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.496651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.496657 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.497956 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.498239 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.498240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.498241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.498306 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.498459 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.498459 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.498460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.498573 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.498758 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.498896 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.498975 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:18:14.499087 18137 log.cc:824] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:14.499819 18137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf: No bootstrap required, opened a new log
I20260809 16:18:14.500619 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:18:14.501236 18137 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.501358 18137 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:14.501379 18137 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37fad879eca44d05a5340ac69c6924bf, State: Initialized, Role: FOLLOWER
I20260809 16:18:14.501482 18137 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.501771 18137 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:14.502094 18153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.502285 18153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: This master's current role is: FOLLOWER
W20260809 16:18:14.503896 18170 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:18:14.503948 18170 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:18:14.505317 17877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } attempt: 2
I20260809 16:18:14.503862 18023 master_runner.cc:186] Error getting master registration for 127.27.217.62:38229: OK, instance_id { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" instance_seqno: 1786292294164136 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 16:18:14.506624 18023 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:18:14.510123 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.501886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38206 (local address 127.27.217.62:38229)
0809 16:18:14.502040 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.502042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.502574 (+ 532us) server_negotiation.cc:407] Connection header received
0809 16:18:14.502667 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.502668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.502677 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.502704 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.503549 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.504231 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.505248 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.505541 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.505608 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.507261 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.507262 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.507263 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.507269 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.508973 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.509321 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.509322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.509322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.509371 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.509588 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.509589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.509589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.509705 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.509765 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.509978 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.510042 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260809 16:18:14.511451 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.501968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33924 (local address 127.27.217.61:46701)
0809 16:18:14.502001 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.502002 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.502012 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:18:14.502069 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.502070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.502078 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.502119 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.502793 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.503422 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.504310 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.504495 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.504547 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.505712 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.505713 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.505713 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.505719 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.507249 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.507650 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.507651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.507652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.507733 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.507934 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.507934 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.507935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.508047 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.508145 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.511292 (+ 3147us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.511367 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:18:14.512995 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.505546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60324)
0809 16:18:14.505671 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.505680 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.505721 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.506074 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.506074 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.506233 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.506282 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.506284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.507264 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.507266 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.508062 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.508066 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.508570 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.508571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.508649 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.508987 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.508991 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.510323 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.511930 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.511931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.511932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.512134 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.512321 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.512322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.512322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.512395 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.512678 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.512679 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.512721 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.512794 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.512893 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 16:18:14.513013 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.505796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60324 (local address 127.27.217.60:38053)
0809 16:18:14.505938 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.505940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.505947 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:18:14.505965 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.505965 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.505988 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.506079 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.506462 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.507184 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.508153 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.508477 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.508776 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.510424 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.510426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.510426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.510432 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.511867 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.512205 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.512206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.512206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.512259 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.512459 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.512459 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.512460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.512611 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.512681 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.512823 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.512917 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260809 16:18:14.514439 17877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d: Bootstrap starting.
I20260809 16:18:14.515179 17877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:14.515509 17877 log.cc:824] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:14.515513 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.503358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60322 (local address 127.27.217.60:38053)
0809 16:18:14.503389 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.503390 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.508556 (+ 5166us) server_negotiation.cc:407] Connection header received
0809 16:18:14.508576 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.508576 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.508585 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.508624 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.509108 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.509762 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.510882 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.511161 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.511221 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.512948 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.512949 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.512949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.512955 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.514462 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.514832 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.514833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.514833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.514885 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.515040 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.515041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.515042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.515135 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.515208 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.515371 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.515437 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:18:14.516263 17877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d: No bootstrap required, opened a new log
I20260809 16:18:14.516772 18153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:14.516867 18153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.517102 18153 leader_election.cc:288] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b84731f09e4ec0bfacfd0daddbbf1d (127.27.217.62:38229), ef0e8603eeed4a91b273cf8218ce4f76 (127.27.217.61:46701)
I20260809 16:18:14.517827 17877 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.517938 17877 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:14.517971 17877 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b84731f09e4ec0bfacfd0daddbbf1d, State: Initialized, Role: FOLLOWER
I20260809 16:18:14.518083 17877 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.518314 18179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.518363 17877 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:14.518566 17841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37fad879eca44d05a5340ac69c6924bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" is_pre_election: true
I20260809 16:18:14.518698 17841 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37fad879eca44d05a5340ac69c6924bf in term 0.
I20260809 16:18:14.518898 18047 leader_election.cc:302] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b84731f09e4ec0bfacfd0daddbbf1d, 37fad879eca44d05a5340ac69c6924bf; no voters:
I20260809 16:18:14.519001 18153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:18:14.519034 18153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:18:14.519053 18153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:14.519876 18153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.519862 18179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [sys.catalog]: This master's current role is: FOLLOWER
W20260809 16:18:14.520529 18192 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:18:14.520583 18192 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:18:14.520753 17841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37fad879eca44d05a5340ac69c6924bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d"
I20260809 16:18:14.520825 17841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:14.521600 17841 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37fad879eca44d05a5340ac69c6924bf in term 1.
I20260809 16:18:14.522161 18047 leader_election.cc:302] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b84731f09e4ec0bfacfd0daddbbf1d, 37fad879eca44d05a5340ac69c6924bf; no voters:
I20260809 16:18:14.522416 18153 leader_election.cc:288] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [CANDIDATE]: Term 1 election: Requested vote from peers 01b84731f09e4ec0bfacfd0daddbbf1d (127.27.217.62:38229), ef0e8603eeed4a91b273cf8218ce4f76 (127.27.217.61:46701)
I20260809 16:18:14.522466 18153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:14.522496 18153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [term 1 LEADER]: Becoming Leader. State: Replica: 37fad879eca44d05a5340ac69c6924bf, State: Running, Role: LEADER
I20260809 16:18:14.522571 18153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.522905 18153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37fad879eca44d05a5340ac69c6924bf. Latest consensus state: current_term: 1 leader_uuid: "37fad879eca44d05a5340ac69c6924bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.522970 18153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:14.523217 18199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:14.521384 17764 master_runner.cc:186] Error getting master registration for 127.27.217.61:46701: OK, instance_id { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" instance_seqno: 1786292294301541 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 16:18:14.523379 17764 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 16:18:14.523474 18199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:14.525163 17841 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [term 1 FOLLOWER]: Refusing update from remote peer 37fad879eca44d05a5340ac69c6924bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:14.525453 18153 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:14.526567 18179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37fad879eca44d05a5340ac69c6924bf. Latest consensus state: current_term: 1 leader_uuid: "37fad879eca44d05a5340ac69c6924bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.526659 18179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:18:14.527942 18153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "37fad879eca44d05a5340ac69c6924bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.528019 18153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:14.528012 18179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "37fad879eca44d05a5340ac69c6924bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.528079 18179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:18:14.528242 18200 mvcc.cc:205] Tried to move back new op lower bound from 7316653238372667392 to 7316653238364991488. Current Snapshot: MvccSnapshot[applied={T|T < 7316653238372667392}]
I20260809 16:18:14.528918 18201 mvcc.cc:205] Tried to move back new op lower bound from 7316653238372667392 to 7316653238364991488. Current Snapshot: MvccSnapshot[applied={T|T < 7316653238372667392}]
I20260809 16:18:14.529630 18199 catalog_manager.cc:1347] Generated new cluster ID: c0669c602cc7472695f5086a5d6294fa
I20260809 16:18:14.529676 18199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:18:14.532256 18015 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } attempt: 3
Aug 09 16:18:14 dist-test-slave-nj21 krb5kdc[17736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:18:14.540107 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.532483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:38053 (local address 127.0.0.1:60330)
0809 16:18:14.532566 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:14.532577 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:14.532614 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:14.532842 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:14.532843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:14.533030 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:14.533075 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.533077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.534059 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.534060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.534881 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:14.534883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.535431 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.535433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:14.535507 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.535950 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:14.535971 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:14.537391 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:14.539070 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.539071 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.539072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.539289 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.539465 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:14.539466 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:14.539466 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:14.539540 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:14.539809 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:14.539810 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:14.539853 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 16:18:14.539912 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 16:18:14.540001 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 16:18:14.540366 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:14.532687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60330 (local address 127.27.217.60:38053)
0809 16:18:14.532723 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:14.532725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:14.532731 (+ 6us) server_negotiation.cc:407] Connection header received
0809 16:18:14.532749 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:14.532749 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:14.532758 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:14.532800 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:14.533185 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.533914 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.534993 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:14.535305 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:14.535359 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:14.537479 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:14.537481 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:14.537481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:14.537488 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:14.538990 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.539345 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.539346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.539346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.539416 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:14.539588 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:14.539589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:14.539589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:14.539726 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:14.539783 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:14.540214 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 16:18:14.540283 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:18:14.541843 18015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: Bootstrap starting.
I20260809 16:18:14.542555 18015 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:14.542829 18015 log.cc:824] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:14.543740 18015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: No bootstrap required, opened a new log
I20260809 16:18:14.545704 18015 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.545826 18015 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:14.545867 18015 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0e8603eeed4a91b273cf8218ce4f76, State: Initialized, Role: FOLLOWER
I20260809 16:18:14.545982 18015 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } }
I20260809 16:18:14.546280 18015 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:14.546241 18220 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.546326 18220 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:18:14.547765 17965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [term 0 FOLLOWER]: Advancing to term 1
W20260809 16:18:14.548125 18240 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:18:14.548168 18240 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:18:14.548635 17965 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [term 1 FOLLOWER]: Refusing update from remote peer 37fad879eca44d05a5340ac69c6924bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:14.549039 18207 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 16:18:14.549646 17933 tablet.cc:2369] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:18:14.549938 17967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37fad879eca44d05a5340ac69c6924bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0e8603eeed4a91b273cf8218ce4f76"
I20260809 16:18:14.550688 17967 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37fad879eca44d05a5340ac69c6924bf in term 1.
I20260809 16:18:14.551218 17968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37fad879eca44d05a5340ac69c6924bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" is_pre_election: true
I20260809 16:18:14.551296 17968 raft_consensus.cc:2362] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 37fad879eca44d05a5340ac69c6924bf in term 1. Re-sending same reply.
I20260809 16:18:14.552490 18220 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37fad879eca44d05a5340ac69c6924bf. Latest consensus state: current_term: 1 leader_uuid: "37fad879eca44d05a5340ac69c6924bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.552569 18220 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:18:14.552599 18220 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "37fad879eca44d05a5340ac69c6924bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.552634 18220 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:18:14.554080 18153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "37fad879eca44d05a5340ac69c6924bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b84731f09e4ec0bfacfd0daddbbf1d" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 38229 } } peers { permanent_uuid: "ef0e8603eeed4a91b273cf8218ce4f76" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 46701 } } peers { permanent_uuid: "37fad879eca44d05a5340ac69c6924bf" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 38053 } } }
I20260809 16:18:14.554167 18153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:14.554661 18199 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:18:14.555392 18199 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:18:14.567561 18199 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37fad879eca44d05a5340ac69c6924bf: Generated new TSK 0
I20260809 16:18:14.567750 18199 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:18:15.520998 18192 catalog_manager.cc:1259] Loaded cluster ID: c0669c602cc7472695f5086a5d6294fa
I20260809 16:18:15.521075 18192 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d: loading cluster ID for follower catalog manager: success
I20260809 16:18:15.521917 18192 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d: acquiring CA information for follower catalog manager: success
I20260809 16:18:15.522209 18192 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 01b84731f09e4ec0bfacfd0daddbbf1d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 16:18:15.548561 18240 catalog_manager.cc:1259] Loaded cluster ID: c0669c602cc7472695f5086a5d6294fa
I20260809 16:18:15.548621 18240 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: loading cluster ID for follower catalog manager: success
I20260809 16:18:15.549396 18240 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: acquiring CA information for follower catalog manager: success
I20260809 16:18:15.549680 18240 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ef0e8603eeed4a91b273cf8218ce4f76: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 16:18:15.618573 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 17764
I20260809 16:18:15.631238 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 17888
I20260809 16:18:15.640189 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 18023
2026-08-09T16:18:15Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2842 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:18:15 dist-test-slave-nj21 krb5kdc[18260](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:18:15 dist-test-slave-nj21 krb5kdc[18260](info): set up 2 sockets
Aug 09 16:18:15 dist-test-slave-nj21 krb5kdc[18260](info): commencing operation
krb5kdc: starting...
W20260809 16:18:16.802011 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:18:16 dist-test-slave-nj21 krb5kdc[18260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:18:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:18:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:18:16.913547 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:37833
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:37833
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:16.993582 18283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:16.993773 18283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:16.993803 18283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:16.994925 18283 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:16.994963 18283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:16.994982 18283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:16.994997 18283 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:16.995012 18283 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:16.996446 18283 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:37833
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:37833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:16.996675 18283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:16.996870 18283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:18:17.001343 18283 server_base.cc:1034] running on GCE node
W20260809 16:18:17.001374 18292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:17.001448 18295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:17.001350 18293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:17.001698 18283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:17.001958 18283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:17.003105 18283 hybrid_clock.cc:648] HybridClock initialized: now 1786292297003091 us; error 30 us; skew 500 ppm
Aug 09 16:18:17 dist-test-slave-nj21 krb5kdc[18260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:17.009624 18283 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:17.010027 18283 webserver.cc:460] Webserver started at http://127.27.217.62:44937/ using document root <none> and password file <none>
I20260809 16:18:17.010231 18283 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:17.010279 18283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:17.010404 18283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:17.011387 18283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "34152bc3dec94665a354bff87f93354e"
format_stamp: "Formatted at 2026-08-09 16:18:17 on dist-test-slave-nj21"
server_key: "85d5054517a46e9e432362b58a7b0f64"
server_key_iv: "52ad426e52d30ef9e9c87e306809db96"
server_key_version: "encryptionkey@0"
I20260809 16:18:17.011736 18283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "34152bc3dec94665a354bff87f93354e"
format_stamp: "Formatted at 2026-08-09 16:18:17 on dist-test-slave-nj21"
server_key: "85d5054517a46e9e432362b58a7b0f64"
server_key_iv: "52ad426e52d30ef9e9c87e306809db96"
server_key_version: "encryptionkey@0"
I20260809 16:18:17.012923 18283 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:17.013556 18305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:17.013698 18283 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:17.013783 18283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "34152bc3dec94665a354bff87f93354e"
format_stamp: "Formatted at 2026-08-09 16:18:17 on dist-test-slave-nj21"
server_key: "85d5054517a46e9e432362b58a7b0f64"
server_key_iv: "52ad426e52d30ef9e9c87e306809db96"
server_key_version: "encryptionkey@0"
I20260809 16:18:17.013846 18283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:17.032579 18283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:17.034504 18283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:17.034631 18283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:17.038287 18283 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:37833
I20260809 16:18:17.038317 18395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:37833 every 8 connection(s)
I20260809 16:18:17.038611 18283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:17.039431 18396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:17.041536 18396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e: Bootstrap starting.
I20260809 16:18:17.042038 18396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:17.042255 18396 log.cc:824] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:17.042850 18396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e: No bootstrap required, opened a new log
I20260809 16:18:17.044413 18396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34152bc3dec94665a354bff87f93354e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37833 } }
I20260809 16:18:17.044543 18396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:17.044564 18396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34152bc3dec94665a354bff87f93354e, State: Initialized, Role: FOLLOWER
I20260809 16:18:17.044659 18396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34152bc3dec94665a354bff87f93354e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37833 } }
I20260809 16:18:17.044706 18396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:18:17.044731 18396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:18:17.044760 18396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:17.045202 18396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34152bc3dec94665a354bff87f93354e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37833 } }
I20260809 16:18:17.045281 18396 leader_election.cc:302] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34152bc3dec94665a354bff87f93354e; no voters:
I20260809 16:18:17.045403 18396 leader_election.cc:288] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:18:17.045430 18400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:17.045575 18400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [term 1 LEADER]: Becoming Leader. State: Replica: 34152bc3dec94665a354bff87f93354e, State: Running, Role: LEADER
I20260809 16:18:17.045616 18396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:17.045667 18400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34152bc3dec94665a354bff87f93354e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37833 } }
I20260809 16:18:17.046059 18403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34152bc3dec94665a354bff87f93354e. Latest consensus state: current_term: 1 leader_uuid: "34152bc3dec94665a354bff87f93354e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34152bc3dec94665a354bff87f93354e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37833 } } }
I20260809 16:18:17.046146 18403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:17.046166 18401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34152bc3dec94665a354bff87f93354e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34152bc3dec94665a354bff87f93354e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37833 } } }
I20260809 16:18:17.046221 18401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:17.046347 18415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:17.046803 18415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:17.047868 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 18283
I20260809 16:18:17.047972 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:18:17.048133 28516 external_mini_cluster.cc:1428] Setting key afff2f6f3d8e44b46909489fa051254e
I20260809 16:18:17.048812 18415 catalog_manager.cc:1347] Generated new cluster ID: 456c0c1f7ccf403a8fe66f0c111eff63
I20260809 16:18:17.048859 18415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:18:17 dist-test-slave-nj21 krb5kdc[18260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:17.055169 18415 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:18:17.055698 18415 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:18:17.058868 18429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:17.048539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48556 (local address 127.27.217.62:37833)
0809 16:18:17.048687 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:17.048696 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:17.048732 (+ 36us) server_negotiation.cc:407] Connection header received
0809 16:18:17.048906 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:17.048913 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:17.048967 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:17.049101 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:17.049789 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:17.051222 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:17.052247 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:17.052838 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:17.052968 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:17.055602 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:17.055605 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:17.055606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:17.055617 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:17.057401 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:17.057780 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:17.057782 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:17.057783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:17.057879 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:17.058052 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:17.058052 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:17.058052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:17.058282 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:17.058417 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:17.058501 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 16:18:17.058633 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260809 16:18:17.059757 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:18:17.073096 18415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34152bc3dec94665a354bff87f93354e: Generated new TSK 0
I20260809 16:18:17.073278 18415 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:18:17.113654 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 18283
2026-08-09T16:18:17Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1475 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:18:17 dist-test-slave-nj21 krb5kdc[18437](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:18:17 dist-test-slave-nj21 krb5kdc[18437](info): set up 2 sockets
Aug 09 16:18:17 dist-test-slave-nj21 krb5kdc[18437](info): commencing operation
krb5kdc: starting...
W20260809 16:18:18.251231 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:18:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:18:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:18:18.366353 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45583
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:45583
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:18.445227 18468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:18.445411 18468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:18.445431 18468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:18.446497 18468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:18.446529 18468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:18.446542 18468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:18.446552 18468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:18.446568 18468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:18.447968 18468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:45583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:18.448145 18468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:18.448308 18468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:18.452665 18475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:18.452680 18482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:18.452670 18477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:18.452831 18468 server_base.cc:1034] running on GCE node
I20260809 16:18:18.453042 18468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:18.453285 18468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:18.454425 18468 hybrid_clock.cc:648] HybridClock initialized: now 1786292298454412 us; error 30 us; skew 500 ppm
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:18.456771 18468 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:18.457178 18468 webserver.cc:460] Webserver started at http://127.27.217.62:40851/ using document root <none> and password file <none>
I20260809 16:18:18.457377 18468 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:18.457424 18468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:18.457546 18468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:18.458509 18468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "56220355ce264e6797e23301adc547d1"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "f62708515dca33820b8d639f6348035e"
server_key_iv: "dba4c46bc9516a1afda4c20f8cd0cc48"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.458820 18468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "56220355ce264e6797e23301adc547d1"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "f62708515dca33820b8d639f6348035e"
server_key_iv: "dba4c46bc9516a1afda4c20f8cd0cc48"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.460037 18468 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:18:18.460675 18492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.460820 18468 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:18.460901 18468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "56220355ce264e6797e23301adc547d1"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "f62708515dca33820b8d639f6348035e"
server_key_iv: "dba4c46bc9516a1afda4c20f8cd0cc48"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.460958 18468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:18.475144 18468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:18.477159 18468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:18.477286 18468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:18.481082 18468 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:45583
I20260809 16:18:18.481123 18576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:45583 every 8 connection(s)
I20260809 16:18:18.481423 18468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:18.482326 18577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:18.484539 18577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Bootstrap starting.
I20260809 16:18:18.485093 18577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:18.485338 18577 log.cc:824] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:18.485965 18577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: No bootstrap required, opened a new log
I20260809 16:18:18.487480 18577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:18.487613 18577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:18.487645 18577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56220355ce264e6797e23301adc547d1, State: Initialized, Role: FOLLOWER
I20260809 16:18:18.487804 18577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:18.487867 18577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:18:18.487890 18577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:18:18.487946 18577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:18.488682 18577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:18.488775 18577 leader_election.cc:302] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56220355ce264e6797e23301adc547d1; no voters:
I20260809 16:18:18.488931 18577 leader_election.cc:288] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:18:18.488965 18581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:18.489096 18581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 1 LEADER]: Becoming Leader. State: Replica: 56220355ce264e6797e23301adc547d1, State: Running, Role: LEADER
I20260809 16:18:18.489182 18577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:18.489189 18581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:18.489578 18584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56220355ce264e6797e23301adc547d1. Latest consensus state: current_term: 1 leader_uuid: "56220355ce264e6797e23301adc547d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } } }
I20260809 16:18:18.489566 18583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56220355ce264e6797e23301adc547d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } } }
I20260809 16:18:18.489670 18584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:18.489676 18583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:18.489899 18590 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:18.490407 18590 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:18.490617 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 18468
I20260809 16:18:18.490727 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:18:18.490909 28516 external_mini_cluster.cc:1428] Setting key dc0d227b77e019a821a749b549622974
I20260809 16:18:18.492061 18590 catalog_manager.cc:1347] Generated new cluster ID: c58b7892c5674a90a22c55c648e1d7b3
I20260809 16:18:18.492111 18590 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:18.502410 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:18.491314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37766 (local address 127.27.217.62:45583)
0809 16:18:18.491479 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:18.491488 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:18.491705 (+ 217us) server_negotiation.cc:407] Connection header received
0809 16:18:18.491823 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:18.491830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:18.491884 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:18.492812 (+ 928us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:18.492916 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.494303 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.495351 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.495991 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.496555 (+ 564us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:18.498841 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:18.498845 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:18.498845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:18.498857 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:18.500747 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.501144 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.501146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.501147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.501242 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.501423 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.501424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.501424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.501697 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:18.501836 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:18.501928 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 16:18:18.502061 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260809 16:18:18.510462 18590 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:18:18.510944 18590 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:18:18.517427 18590 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Generated new TSK 0
I20260809 16:18:18.517584 18590 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:18:18.547480 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45583
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:18.626361 18611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:18.626561 18611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:18.626582 18611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:18.627718 18611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:18.627756 18611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:18.627784 18611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:18:18.629194 18611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:18.629422 18611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:18.629637 18611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:18.634279 18619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:18.634330 18611 server_base.cc:1034] running on GCE node
W20260809 16:18:18.634266 18617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:18.634253 18621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:18.634656 18611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:18.634850 18611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:18.636013 18611 hybrid_clock.cc:648] HybridClock initialized: now 1786292298635998 us; error 28 us; skew 500 ppm
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:18.638613 18611 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:18:18.639027 18611 webserver.cc:460] Webserver started at http://127.27.217.1:40245/ using document root <none> and password file <none>
I20260809 16:18:18.639240 18611 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:18.639292 18611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:18.639416 18611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:18.640475 18611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "c3956af4054c4067a7b78d090f564e9c"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "179f3bd6981368eff840ae1927c4fac9"
server_key_iv: "55dd03b9e0a1016eba3e56f0217384d5"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.640812 18611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "c3956af4054c4067a7b78d090f564e9c"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "179f3bd6981368eff840ae1927c4fac9"
server_key_iv: "55dd03b9e0a1016eba3e56f0217384d5"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.642114 18611 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:18:18.642832 18632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.642988 18611 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:18:18.643078 18611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "c3956af4054c4067a7b78d090f564e9c"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "179f3bd6981368eff840ae1927c4fac9"
server_key_iv: "55dd03b9e0a1016eba3e56f0217384d5"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.643146 18611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:18.664322 18611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:18.666561 18611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:18.666707 18611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:18.666929 18611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:18.667253 18611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:18.667294 18611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.667325 18611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:18.667353 18611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.673617 18611 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:45173
I20260809 16:18:18.673679 18822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:45173 every 8 connection(s)
I20260809 16:18:18.673961 18611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:18.682374 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 18611
I20260809 16:18:18.682466 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:18:18.682636 28516 external_mini_cluster.cc:1428] Setting key 3db511fcb23942c5d26a84330deed0e3
I20260809 16:18:18.682695 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:18.674639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:53477 (local address 127.27.217.62:45583)
0809 16:18:18.674697 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:18.674699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:18.674955 (+ 256us) server_negotiation.cc:407] Connection header received
0809 16:18:18.675472 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:18.675474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:18.675492 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:18.675544 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:18.676511 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.677019 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.677981 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.678202 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.678258 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:18.680271 (+ 2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:18.680272 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:18.680273 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:18.680285 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:18.681384 (+ 1099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.681734 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.681736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.681736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.681816 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.682035 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.682036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.682036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.682147 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:18.682203 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:18.682511 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 16:18:18.682602 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:18:18.682816 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:18.674606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:53477)
0809 16:18:18.674815 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:18.674863 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:18.675366 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:18.675614 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:18.675618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:18.676212 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:18.676404 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:18.676409 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.677104 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.677105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:18.677898 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:18.677900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.678277 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.678279 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:18.678403 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:18.678821 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:18.678829 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:18.680175 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:18.681457 (+ 1282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:18.681464 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:18.681466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:18.681669 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:18.681875 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:18.681876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:18.681876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:18.681978 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:18.682202 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:18.682229 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:18.682357 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 16:18:18.682445 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 16:18:18.682605 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":111,"threads_started":1}
I20260809 16:18:18.683456 18824 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45583
I20260809 16:18:18.683547 18824 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:18.683743 18824 heartbeater.cc:511] Master 127.27.217.62:45583 requested a full tablet report, sending...
I20260809 16:18:18.684278 18515 ts_manager.cc:194] Registered new tserver with Master: c3956af4054c4067a7b78d090f564e9c (127.27.217.1:45173)
I20260809 16:18:18.684914 18515 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:53477
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:18:18.706717 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45583
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:18.786255 18830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:18.786448 18830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:18.786479 18830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:18.787575 18830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:18.787616 18830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:18.787649 18830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:18:18.789109 18830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:18.789338 18830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:18.789582 18830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:18.794126 18841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:18.794137 18838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:18.794139 18836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:18.794281 18830 server_base.cc:1034] running on GCE node
I20260809 16:18:18.794497 18830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:18.794685 18830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:18.795810 18830 hybrid_clock.cc:648] HybridClock initialized: now 1786292298795799 us; error 25 us; skew 500 ppm
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:18.798127 18830 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:18:18.798514 18830 webserver.cc:460] Webserver started at http://127.27.217.2:36425/ using document root <none> and password file <none>
I20260809 16:18:18.798687 18830 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:18.798725 18830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:18.798815 18830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:18.799782 18830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "44686856ec22422396f6c07e193e55a8"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7fcc9b9784ea03b11c3afa7b4d8f0429"
server_key_iv: "c9ffeeab8ba2b5c167747b711d0d308b"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.800071 18830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "44686856ec22422396f6c07e193e55a8"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7fcc9b9784ea03b11c3afa7b4d8f0429"
server_key_iv: "c9ffeeab8ba2b5c167747b711d0d308b"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.801205 18830 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:18.801803 18854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.801949 18830 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:18.802026 18830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "44686856ec22422396f6c07e193e55a8"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7fcc9b9784ea03b11c3afa7b4d8f0429"
server_key_iv: "c9ffeeab8ba2b5c167747b711d0d308b"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.802085 18830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:18.819485 18830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:18.821105 18830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:18.821226 18830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:18.821408 18830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:18.821691 18830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:18.821727 18830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.821748 18830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:18.821769 18830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.827262 18830 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:34095
I20260809 16:18:18.827303 19044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:34095 every 8 connection(s)
I20260809 16:18:18.827567 18830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:18:18.831336 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 18830
I20260809 16:18:18.831451 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:18:18.831642 28516 external_mini_cluster.cc:1428] Setting key 55e6b1bdaec0299b3610d05167a52e03
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:18.836284 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:18.828246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:58809 (local address 127.27.217.62:45583)
0809 16:18:18.828307 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:18.828310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:18.828488 (+ 178us) server_negotiation.cc:407] Connection header received
0809 16:18:18.828996 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:18.828997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:18.829010 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:18.829061 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:18.829960 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.830466 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.831568 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.831824 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.831889 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:18.833830 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:18.833832 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:18.833832 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:18.833854 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:18.835034 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.835446 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.835447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.835447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.835489 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.835736 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.835737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.835737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.835827 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:18.835883 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:18.836163 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 16:18:18.836222 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:18:18.836548 19049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:18.828207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:58809)
0809 16:18:18.828365 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:18.828406 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:18.828888 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:18.829126 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:18.829129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:18.829681 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:18.829861 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:18.829865 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.830546 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.830547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:18.831487 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:18.831490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.831910 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.831911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:18.832035 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:18.832478 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:18.832487 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:18.833745 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:18.835107 (+ 1362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:18.835114 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:18.835116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:18.835370 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:18.835535 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:18.835536 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:18.835536 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:18.835658 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:18.835889 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:18.835895 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:18.836045 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 16:18:18.836152 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 16:18:18.836311 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260809 16:18:18.837023 19045 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45583
I20260809 16:18:18.837105 19045 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:18.837267 19045 heartbeater.cc:511] Master 127.27.217.62:45583 requested a full tablet report, sending...
I20260809 16:18:18.837641 18515 ts_manager.cc:194] Registered new tserver with Master: 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095)
I20260809 16:18:18.838114 18515 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:58809
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:18:18.856576 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45583
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:18.934725 19053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:18.934919 19053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:18.934942 19053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:18.936024 19053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:18.936056 19053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:18.936080 19053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:18:18.937433 19053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:18.937602 19053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:18.937768 19053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:18.942363 19067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:18.942359 19064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:18.942413 19063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:18.942653 19053 server_base.cc:1034] running on GCE node
I20260809 16:18:18.942826 19053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:18.943056 19053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:18.944190 19053 hybrid_clock.cc:648] HybridClock initialized: now 1786292298944171 us; error 28 us; skew 500 ppm
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:18.946561 19053 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:18:18.946966 19053 webserver.cc:460] Webserver started at http://127.27.217.3:39433/ using document root <none> and password file <none>
I20260809 16:18:18.947183 19053 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:18.947232 19053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:18.947364 19053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:18.948361 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "12746e30fdcb463685da4ecfacdc2148"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7f8b2bf706561853c1c76fa91e4c8f90"
server_key_iv: "2a2d331416a8a7eb73c8ce8eaeaa6810"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.948674 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "12746e30fdcb463685da4ecfacdc2148"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7f8b2bf706561853c1c76fa91e4c8f90"
server_key_iv: "2a2d331416a8a7eb73c8ce8eaeaa6810"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.949855 19053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:18:18.950481 19079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.950626 19053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:18.950709 19053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "12746e30fdcb463685da4ecfacdc2148"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7f8b2bf706561853c1c76fa91e4c8f90"
server_key_iv: "2a2d331416a8a7eb73c8ce8eaeaa6810"
server_key_version: "encryptionkey@0"
I20260809 16:18:18.950764 19053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:18.967207 19053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:18.968819 19053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:18.968942 19053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:18.969132 19053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:18.969405 19053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:18.969439 19053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.969480 19053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:18.969503 19053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:18.974839 19053 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:46297
I20260809 16:18:18.974906 19278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:46297 every 8 connection(s)
I20260809 16:18:18.975149 19053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:18:18 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292298, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:18.980849 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 19053
I20260809 16:18:18.980966 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:18:18.981151 28516 external_mini_cluster.cc:1428] Setting key 55a101dd2c7c3279ebed45833466a5ba
I20260809 16:18:18.983327 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:18.975818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:49179 (local address 127.27.217.62:45583)
0809 16:18:18.975874 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:18.975876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:18.976076 (+ 200us) server_negotiation.cc:407] Connection header received
0809 16:18:18.976517 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:18.976519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:18.976529 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:18.976577 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:18.977433 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.977946 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.978895 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.979092 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.979146 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:18.981099 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:18.981101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:18.981101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:18.981107 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:18.982365 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.982686 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.982686 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.982687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.982731 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.982884 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.982884 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.982885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.982976 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:18.983023 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:18.983201 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 16:18:18.983255 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 16:18:18.983475 19284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:18.975823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:49179)
0809 16:18:18.975964 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:18.975996 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:18.976444 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:18.976624 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:18.976627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:18.977148 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:18.977323 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:18.977328 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.978022 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.978023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:18.978812 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:18.978815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.979152 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.979153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:18.979241 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:18.979654 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:18.979662 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:18.981012 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:18.982430 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:18.982435 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:18.982436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:18.982633 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:18.982769 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:18.982770 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:18.982770 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:18.982847 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:18.983018 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:18.983021 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:18.983117 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 16:18:18.983189 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 16:18:18.983297 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260809 16:18:18.984020 19279 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45583
I20260809 16:18:18.984100 19279 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:18.984230 19279 heartbeater.cc:511] Master 127.27.217.62:45583 requested a full tablet report, sending...
I20260809 16:18:18.984531 18515 ts_manager.cc:194] Registered new tserver with Master: 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
I20260809 16:18:18.984849 18515 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:49179
I20260809 16:18:18.992722 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:18:18.999547 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:18.994009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37772 (local address 127.27.217.62:45583)
0809 16:18:18.994059 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:18.994061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:18.994177 (+ 116us) server_negotiation.cc:407] Connection header received
0809 16:18:18.994238 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:18.994240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:18.994248 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:18.994289 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:18.994831 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.995282 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.996037 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:18.996217 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:18.996268 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:18.997332 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:18.997333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:18.997334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:18.997340 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:18.998526 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.998835 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.998836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.998836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.998886 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:18.999048 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:18.999049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:18.999049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:18.999182 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:18.999265 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:18.999365 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 16:18:18.999444 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:18:19.000929 18515 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:18:19.002538 18515 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:18:19.008285 19294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.004451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46297 (local address 127.0.0.1:39742)
0809 16:18:19.004802 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.004813 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.004866 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.005439 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.005440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.005442 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.005478 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.005479 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.006376 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.006377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.007279 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.007282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.008070 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.008071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.008128 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.008137 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.008187 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.008224 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":57,"thread_start_us":50,"threads_started":1}
I20260809 16:18:19.008311 19302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.004688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39742 (local address 127.27.217.3:46297)
0809 16:18:19.005215 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.005219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.005227 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:18:19.005319 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.005322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.005336 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.005560 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.005613 (+ 53us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.006289 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.007361 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.007997 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.008068 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.008121 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.008199 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.008236 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":77,"threads_started":1}
I20260809 16:18:19.008778 19299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.004445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:45173 (local address 127.0.0.1:37936)
0809 16:18:19.004692 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.004732 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.004793 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.005059 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.005062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.005064 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.005109 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.005110 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.006432 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.006433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.007610 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.007613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.008523 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.008525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.008600 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.008604 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.008655 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.008695 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":20,"thread_start_us":54,"threads_started":1}
I20260809 16:18:19.008801 19301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.004586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37936 (local address 127.27.217.1:45173)
0809 16:18:19.004776 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.004781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.004792 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:18:19.004875 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.004877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.004893 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.004968 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.005185 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.006313 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.007712 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.008407 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.008470 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.008530 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.008687 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.008732 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":106,"threads_started":1}
I20260809 16:18:19.009045 19164 tablet_service.cc:1467] Processing CreateTablet for tablet f339940e443344888e790e50b4efe167 (DEFAULT_TABLE table=test-table [id=0b90c455cd364f0985828d16c29483da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:19.009403 19164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f339940e443344888e790e50b4efe167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:19.009609 19297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.004460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34095 (local address 127.0.0.1:38070)
0809 16:18:19.004893 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.004918 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.004955 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.005155 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.005155 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.005157 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.005196 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.005198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.006432 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.006433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.007611 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.007613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.009310 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.009311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.009370 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.009374 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.009430 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.009546 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":46,"thread_start_us":45,"threads_started":1}
I20260809 16:18:19.009529 18722 tablet_service.cc:1467] Processing CreateTablet for tablet f339940e443344888e790e50b4efe167 (DEFAULT_TABLE table=test-table [id=0b90c455cd364f0985828d16c29483da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:19.009863 19304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.004870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38070 (local address 127.27.217.2:34095)
0809 16:18:19.005016 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.005020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.005029 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:18:19.005067 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.005069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.005080 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.005142 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.005262 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.006326 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.008569 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.009239 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.009308 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.009358 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.009744 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.009788 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
I20260809 16:18:19.009882 18722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f339940e443344888e790e50b4efe167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:19.010432 18935 tablet_service.cc:1467] Processing CreateTablet for tablet f339940e443344888e790e50b4efe167 (DEFAULT_TABLE table=test-table [id=0b90c455cd364f0985828d16c29483da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:19.010747 18935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f339940e443344888e790e50b4efe167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:19.012399 19305 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Bootstrap starting.
I20260809 16:18:19.012840 19308 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: Bootstrap starting.
I20260809 16:18:19.013025 19305 tablet_bootstrap.cc:654] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:19.013468 19305 log.cc:824] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:19.013489 19308 tablet_bootstrap.cc:654] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:19.013958 19311 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Bootstrap starting.
I20260809 16:18:19.014014 19308 log.cc:824] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:19.014251 19305 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: No bootstrap required, opened a new log
I20260809 16:18:19.014364 19305 ts_tablet_manager.cc:1397] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:18:19.014592 19311 tablet_bootstrap.cc:654] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:19.014670 19308 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: No bootstrap required, opened a new log
I20260809 16:18:19.014736 19308 ts_tablet_manager.cc:1397] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:19.015100 19311 log.cc:824] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:19.015890 19311 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: No bootstrap required, opened a new log
I20260809 16:18:19.015959 19311 ts_tablet_manager.cc:1397] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:18:19.016245 19305 raft_consensus.cc:348] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.016294 19308 raft_consensus.cc:348] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.016405 19308 raft_consensus.cc:374] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:19.016407 19305 raft_consensus.cc:374] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:19.016435 19308 raft_consensus.cc:729] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12746e30fdcb463685da4ecfacdc2148, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.016439 19305 raft_consensus.cc:729] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3956af4054c4067a7b78d090f564e9c, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.016541 19308 consensus_queue.cc:260] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.016579 19305 consensus_queue.cc:260] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.016790 19279 heartbeater.cc:503] Master 127.27.217.62:45583 was elected leader, sending a full tablet report...
I20260809 16:18:19.016846 19305 ts_tablet_manager.cc:1428] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:18:19.016975 18824 heartbeater.cc:503] Master 127.27.217.62:45583 was elected leader, sending a full tablet report...
I20260809 16:18:19.016795 19308 ts_tablet_manager.cc:1428] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:18:19.017815 19311 raft_consensus.cc:348] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.017956 19311 raft_consensus.cc:374] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:19.017992 19311 raft_consensus.cc:729] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44686856ec22422396f6c07e193e55a8, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.018096 19311 consensus_queue.cc:260] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.018333 19311 ts_tablet_manager.cc:1428] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 16:18:19.018363 19045 heartbeater.cc:503] Master 127.27.217.62:45583 was elected leader, sending a full tablet report...
I20260809 16:18:19.060976 19317 raft_consensus.cc:482] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:19.061098 19317 raft_consensus.cc:504] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.061461 19317 leader_election.cc:288] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
I20260809 16:18:19.064363 19302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.061695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:49115 (local address 127.27.217.3:46297)
0809 16:18:19.061751 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.061754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.061846 (+ 92us) server_negotiation.cc:407] Connection header received
0809 16:18:19.061877 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.061878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.061886 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.061934 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.062072 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.062533 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.063549 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.064072 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.064134 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.064143 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.064268 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.064301 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:18:19.064393 19304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.061659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:53435 (local address 127.27.217.2:34095)
0809 16:18:19.061702 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.061704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.061712 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:18:19.061786 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.061787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.061793 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.061840 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.062087 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.062531 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.063561 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.064084 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.064145 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.064153 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.064292 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.064324 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:18:19.064411 19319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.061623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46297 (local address 127.27.217.1:49115)
0809 16:18:19.061776 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.061785 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.061838 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.061942 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.061943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.061944 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.062008 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.062009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.062602 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.062602 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.063478 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.063480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.064143 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.064144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.064210 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.064213 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.064257 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.064294 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":4,"thread_start_us":96,"threads_started":1}
I20260809 16:18:19.064419 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.061610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34095 (local address 127.27.217.1:53435)
0809 16:18:19.061663 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.061673 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.061712 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.061973 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.061973 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.061975 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.062026 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.062028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.062603 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.062604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.063475 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.063477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.064152 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.064153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.064226 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.064229 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.064277 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.064324 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":74}
I20260809 16:18:19.064817 19194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f339940e443344888e790e50b4efe167" candidate_uuid: "c3956af4054c4067a7b78d090f564e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12746e30fdcb463685da4ecfacdc2148" is_pre_election: true
I20260809 16:18:19.064998 19194 raft_consensus.cc:2454] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3956af4054c4067a7b78d090f564e9c in term 0.
I20260809 16:18:19.064956 18972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f339940e443344888e790e50b4efe167" candidate_uuid: "c3956af4054c4067a7b78d090f564e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44686856ec22422396f6c07e193e55a8" is_pre_election: true
I20260809 16:18:19.065090 18972 raft_consensus.cc:2454] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3956af4054c4067a7b78d090f564e9c in term 0.
I20260809 16:18:19.065291 18635 leader_election.cc:302] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44686856ec22422396f6c07e193e55a8, c3956af4054c4067a7b78d090f564e9c; no voters:
I20260809 16:18:19.065465 19317 raft_consensus.cc:2781] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:18:19.065514 19317 raft_consensus.cc:482] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:18:19.065537 19317 raft_consensus.cc:3037] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:19.066267 19317 raft_consensus.cc:504] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.066387 19317 leader_election.cc:288] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 1 election: Requested vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
I20260809 16:18:19.066524 18972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f339940e443344888e790e50b4efe167" candidate_uuid: "c3956af4054c4067a7b78d090f564e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44686856ec22422396f6c07e193e55a8"
I20260809 16:18:19.066537 19194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f339940e443344888e790e50b4efe167" candidate_uuid: "c3956af4054c4067a7b78d090f564e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12746e30fdcb463685da4ecfacdc2148"
I20260809 16:18:19.066598 18972 raft_consensus.cc:3037] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:19.066612 19194 raft_consensus.cc:3037] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:19.067272 18972 raft_consensus.cc:2454] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3956af4054c4067a7b78d090f564e9c in term 1.
I20260809 16:18:19.067299 19194 raft_consensus.cc:2454] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3956af4054c4067a7b78d090f564e9c in term 1.
I20260809 16:18:19.067430 18635 leader_election.cc:302] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44686856ec22422396f6c07e193e55a8, c3956af4054c4067a7b78d090f564e9c; no voters:
I20260809 16:18:19.067523 19317 raft_consensus.cc:2781] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:19.067663 19317 raft_consensus.cc:686] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 1 LEADER]: Becoming Leader. State: Replica: c3956af4054c4067a7b78d090f564e9c, State: Running, Role: LEADER
I20260809 16:18:19.067775 19317 consensus_queue.cc:237] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.068533 18515 catalog_manager.cc:5495] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c reported cstate change: term changed from 0 to 1, leader changed from <none> to c3956af4054c4067a7b78d090f564e9c (127.27.217.1). New cstate: current_term: 1 leader_uuid: "c3956af4054c4067a7b78d090f564e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } health_report { overall_health: UNKNOWN } } }
W20260809 16:18:19.078069 19048 tablet.cc:2369] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:18:19.082154 19301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.080225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37938 (local address 127.27.217.1:45173)
0809 16:18:19.080270 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.080271 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.080279 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:18:19.080333 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.080334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.080355 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.080401 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:18:19.080507 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.080927 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.081616 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.081782 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.081822 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.081928 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:18:19.082012 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:18:19.082063 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.082076 (+ 13us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.082089 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 16:18:19.083649 19194 raft_consensus.cc:1261] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 1 FOLLOWER]: Refusing update from remote peer c3956af4054c4067a7b78d090f564e9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:19.083647 18972 raft_consensus.cc:1261] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 1 FOLLOWER]: Refusing update from remote peer c3956af4054c4067a7b78d090f564e9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:19.084008 19317 consensus_queue.cc:1035] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:19.084116 19321 consensus_queue.cc:1035] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:19.086254 19324 mvcc.cc:205] Tried to move back new op lower bound from 7316653257044467712 to 7316653256982122496. Current Snapshot: MvccSnapshot[applied={T|T < 7316653257044467712}]
I20260809 16:18:19.086952 19325 mvcc.cc:205] Tried to move back new op lower bound from 7316653257044467712 to 7316653256982122496. Current Snapshot: MvccSnapshot[applied={T|T < 7316653257044467712}]
I20260809 16:18:19.088485 18514 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:19.088567 18514 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:19.089269 18514 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Sending DeleteTablet for 3 replicas of tablet f339940e443344888e790e50b4efe167
I20260809 16:18:19.089586 18722 tablet_service.cc:1514] Processing DeleteTablet for tablet f339940e443344888e790e50b4efe167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:19 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:37936
I20260809 16:18:19.089615 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 18611
I20260809 16:18:19.092195 19164 tablet_service.cc:1514] Processing DeleteTablet for tablet f339940e443344888e790e50b4efe167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:19 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:39742
I20260809 16:18:19.101778 18935 tablet_service.cc:1514] Processing DeleteTablet for tablet f339940e443344888e790e50b4efe167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:19 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:38070
I20260809 16:18:19.102555 19342 tablet_replica.cc:330] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: stopping tablet replica
I20260809 16:18:19.102682 19342 raft_consensus.cc:2229] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:19.102802 19342 raft_consensus.cc:2258] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:19.103197 19342 ts_tablet_manager.cc:1905] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:19.104882 19342 ts_tablet_manager.cc:1918] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:19.104964 19342 log.cc:1196] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/f339940e443344888e790e50b4efe167
I20260809 16:18:19.105227 19342 ts_tablet_manager.cc:1939] T f339940e443344888e790e50b4efe167 P 44686856ec22422396f6c07e193e55a8: Deleting consensus metadata
I20260809 16:18:19.105631 18495 catalog_manager.cc:4841] TS 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095): tablet f339940e443344888e790e50b4efe167 (table test-table [id=0b90c455cd364f0985828d16c29483da]) successfully deleted
W20260809 16:18:19.106801 18493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:45173 (error 108)
I20260809 16:18:19.106966 19341 tablet_replica.cc:330] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: stopping tablet replica
I20260809 16:18:19.107084 19341 raft_consensus.cc:2229] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:19.107208 19341 raft_consensus.cc:2258] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:19.107308 19297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.107176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:45173 (local address 127.0.0.1:37946)
0809 16:18:19.107227 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.107271 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:45173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260809 16:18:19.107427 18493 catalog_manager.cc:4584] TS c3956af4054c4067a7b78d090f564e9c (127.27.217.1:45173): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f339940e443344888e790e50b4efe167: Network error: Client connection negotiation failed: client connection to 127.27.217.1:45173: connect: Connection refused (error 111)
I20260809 16:18:19.107448 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 18830
I20260809 16:18:19.110493 19341 ts_tablet_manager.cc:1905] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:19.112792 19341 ts_tablet_manager.cc:1918] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:19.112870 19341 log.cc:1196] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/f339940e443344888e790e50b4efe167
I20260809 16:18:19.113111 19341 ts_tablet_manager.cc:1939] T f339940e443344888e790e50b4efe167 P 12746e30fdcb463685da4ecfacdc2148: Deleting consensus metadata
I20260809 16:18:19.113497 18494 catalog_manager.cc:4841] TS 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297): tablet f339940e443344888e790e50b4efe167 (table test-table [id=0b90c455cd364f0985828d16c29483da]) successfully deleted
I20260809 16:18:19.115906 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 19053
I20260809 16:18:19.126610 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 18468
I20260809 16:18:19.134501 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45583
--webserver_interface=127.27.217.62
--webserver_port=40851
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:45583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:19.215129 19344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:19.215334 19344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:19.215355 19344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:19.216460 19344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:19.216495 19344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:19.216507 19344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:19.216518 19344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:19.216529 19344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:19.217900 19344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:45583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=40851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:19.218079 19344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:19.218250 19344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:19.226847 19353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:19.226818 19357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:19.226837 19352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:19.226876 19344 server_base.cc:1034] running on GCE node
I20260809 16:18:19.227275 19344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:19.227573 19344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:19.228710 19344 hybrid_clock.cc:648] HybridClock initialized: now 1786292299228706 us; error 45 us; skew 500 ppm
Aug 09 16:18:19 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292299, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:19.231099 19344 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:19.231498 19344 webserver.cc:460] Webserver started at http://127.27.217.62:40851/ using document root <none> and password file <none>
I20260809 16:18:19.231731 19344 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:19.231806 19344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:19.233073 19344 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:19.233636 19366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.233804 19344 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:19.233896 19344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "56220355ce264e6797e23301adc547d1"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "f62708515dca33820b8d639f6348035e"
server_key_iv: "dba4c46bc9516a1afda4c20f8cd0cc48"
server_key_version: "encryptionkey@0"
I20260809 16:18:19.234256 19344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:19.244812 19344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:19.246338 19344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:19.246459 19344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:19.250315 19344 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:45583
I20260809 16:18:19.250349 19455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:45583 every 8 connection(s)
I20260809 16:18:19.250684 19344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:19.252312 19456 sys_catalog.cc:263] Verifying existing consensus state
I20260809 16:18:19.252952 19456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Bootstrap starting.
I20260809 16:18:19.259766 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 19344
I20260809 16:18:19.260104 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:45173
--local_ip_for_outbound_sockets=127.27.217.1
--tserver_master_addrs=127.27.217.62:45583
--webserver_port=40245
--webserver_interface=127.27.217.1
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:19.261160 19456 log.cc:824] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:19.262964 19456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:18:19.263219 19456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Bootstrap complete.
I20260809 16:18:19.265285 19456 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:19.265507 19456 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56220355ce264e6797e23301adc547d1, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.265642 19456 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:19.265702 19456 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:18:19.265734 19456 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:18:19.265779 19456 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 1 FOLLOWER]: Advancing to term 2
I20260809 16:18:19.266726 19456 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:19.266808 19456 leader_election.cc:302] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56220355ce264e6797e23301adc547d1; no voters:
I20260809 16:18:19.266963 19456 leader_election.cc:288] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 16:18:19.267014 19463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 16:18:19.267119 19463 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 2 LEADER]: Becoming Leader. State: Replica: 56220355ce264e6797e23301adc547d1, State: Running, Role: LEADER
I20260809 16:18:19.267216 19456 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:19.267211 19463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:19.267621 19463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56220355ce264e6797e23301adc547d1. Latest consensus state: current_term: 2 leader_uuid: "56220355ce264e6797e23301adc547d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } } }
I20260809 16:18:19.267716 19463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:19.267854 19464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "56220355ce264e6797e23301adc547d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } } }
I20260809 16:18:19.267928 19464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:19.268997 19482 catalog_manager.cc:1259] Loaded cluster ID: c58b7892c5674a90a22c55c648e1d7b3
I20260809 16:18:19.269044 19482 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: loading cluster ID for follower catalog manager: success
W20260809 16:18:19.269228 19482 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260809 16:18:19.269270 19482 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260809 16:18:19.269302 19468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:19.269645 19468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:19.269722 19468 catalog_manager.cc:1259] Loaded cluster ID: c58b7892c5674a90a22c55c648e1d7b3
I20260809 16:18:19.269752 19468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:18:19.269887 19468 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 16:18:19.274520 19468 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 16:18:19.276822 19468 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:18:19.277025 19468 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Loaded TSK: 0
I20260809 16:18:19.277246 19468 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 16:18:19.342025 19461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:19.342209 19461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:19.342240 19461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:19.343329 19461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:19.343366 19461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:19.343400 19461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:18:19.344830 19461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:45173
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=40245
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:19.345064 19461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:19.345274 19461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:19.349911 19494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:19.349907 19497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:19.350100 19502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:19.350571 19461 server_base.cc:1034] running on GCE node
I20260809 16:18:19.350755 19461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:19.350986 19461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:19.352125 19461 hybrid_clock.cc:648] HybridClock initialized: now 1786292299352108 us; error 33 us; skew 500 ppm
Aug 09 16:18:19 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292299, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:19.354625 19461 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:18:19.355116 19461 webserver.cc:460] Webserver started at http://127.27.217.1:40245/ using document root <none> and password file <none>
I20260809 16:18:19.355377 19461 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:19.355453 19461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:19.357128 19461 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:19.357860 19513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.358022 19461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:19.358115 19461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "c3956af4054c4067a7b78d090f564e9c"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "179f3bd6981368eff840ae1927c4fac9"
server_key_iv: "55dd03b9e0a1016eba3e56f0217384d5"
server_key_version: "encryptionkey@0"
I20260809 16:18:19.358484 19461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:19.375079 19461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:19.377385 19461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:19.377528 19461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:19.377759 19461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:19.378237 19524 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 16:18:19.379616 19461 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 16:18:19.379698 19461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 16:18:19.379732 19461 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 16:18:19.380560 19461 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 16:18:19.380605 19461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 16:18:19.380689 19524 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Bootstrap starting.
I20260809 16:18:19.387179 19461 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:45173
I20260809 16:18:19.387485 19703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:45173 every 8 connection(s)
I20260809 16:18:19.387571 19461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:18:19.391312 19524 log.cc:824] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:19.393784 19524 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:18:19.394115 19524 tablet_bootstrap.cc:492] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Bootstrap complete.
I20260809 16:18:19.395090 19524 ts_tablet_manager.cc:1397] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.011s
I20260809 16:18:19.395817 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 19461
I20260809 16:18:19.396134 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:34095
--local_ip_for_outbound_sockets=127.27.217.2
--tserver_master_addrs=127.27.217.62:45583
--webserver_port=36425
--webserver_interface=127.27.217.2
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:19.396466 19524 raft_consensus.cc:348] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
Aug 09 16:18:19 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292299, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:19.396788 19524 raft_consensus.cc:729] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3956af4054c4067a7b78d090f564e9c, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.396953 19524 consensus_queue.cc:260] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } }
I20260809 16:18:19.397226 19524 ts_tablet_manager.cc:1428] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Time spent starting tablet: real 0.002s user 0.004s sys 0.001s
I20260809 16:18:19.401479 19707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.388418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:45997)
0809 16:18:19.388835 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.388902 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.389628 (+ 726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.390135 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.390140 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.390621 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:19.390927 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.390934 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.392604 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.392605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.393883 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.393886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.394735 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.394736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.394879 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.395497 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:19.395506 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:19.397468 (+ 1962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:19.399637 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:19.399644 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:19.399646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:19.399981 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:19.400305 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:19.400306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:19.400306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:19.400430 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:19.400887 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:19.400893 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:19.401040 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.401140 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.401297 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":92,"threads_started":1}
I20260809 16:18:19.402055 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.388556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:45997 (local address 127.27.217.62:45583)
0809 16:18:19.388759 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.388769 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.389024 (+ 255us) server_negotiation.cc:407] Connection header received
0809 16:18:19.389856 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.389863 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.389931 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.390067 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:19.391068 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.392458 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.394023 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.394613 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.394726 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.397593 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:19.397597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:19.397598 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:19.397611 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:19.399550 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:19.400077 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:19.400080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:19.400080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:19.400227 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:19.400499 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:19.400499 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:19.400500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:19.400806 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:19.400918 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.401745 (+ 827us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.401874 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":112,"threads_started":1}
I20260809 16:18:19.403420 19704 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45583
I20260809 16:18:19.403535 19704 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:19.403764 19704 heartbeater.cc:511] Master 127.27.217.62:45583 requested a full tablet report, sending...
I20260809 16:18:19.404604 19398 ts_manager.cc:194] Registered new tserver with Master: c3956af4054c4067a7b78d090f564e9c (127.27.217.1:45173)
I20260809 16:18:19.405638 19398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:45997
I20260809 16:18:19.406558 19704 heartbeater.cc:503] Master 127.27.217.62:45583 was elected leader, sending a full tablet report...
I20260809 16:18:19.410960 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.405300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37952 (local address 127.27.217.1:45173)
0809 16:18:19.407749 (+ 2449us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.407752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.407759 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:18:19.407783 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.407784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.407796 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.407858 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.408049 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.408660 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.410151 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.410578 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.410629 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.410662 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.410883 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.410916 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2423,"thread_start_us":71,"threads_started":1}
I20260809 16:18:19.410998 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.405244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:45173 (local address 127.0.0.1:37952)
0809 16:18:19.405415 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.405449 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.405509 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.407896 (+ 2387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.407900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.407903 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.407974 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.407976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.408735 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.408736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.410071 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.410075 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.410667 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.410668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.410779 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.410794 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.410869 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.410922 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
I20260809 16:18:19.411406 19586 tablet_service.cc:1514] Processing DeleteTablet for tablet f339940e443344888e790e50b4efe167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:19 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:37952
I20260809 16:18:19.411878 19718 tablet_replica.cc:330] stopping tablet replica
I20260809 16:18:19.411984 19718 raft_consensus.cc:2229] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:19.412048 19718 raft_consensus.cc:2258] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:19.412354 19718 ts_tablet_manager.cc:1905] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:19.414498 19718 ts_tablet_manager.cc:1918] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:19.414569 19718 log.cc:1196] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/f339940e443344888e790e50b4efe167
I20260809 16:18:19.414788 19718 ts_tablet_manager.cc:1939] T f339940e443344888e790e50b4efe167 P c3956af4054c4067a7b78d090f564e9c: Deleting consensus metadata
I20260809 16:18:19.415256 19367 catalog_manager.cc:4841] TS c3956af4054c4067a7b78d090f564e9c (127.27.217.1:45173): tablet f339940e443344888e790e50b4efe167 (table test-table [id=0b90c455cd364f0985828d16c29483da]) successfully deleted
W20260809 16:18:19.481207 19713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:19.481396 19713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:19.481427 19713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:19.482522 19713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:19.482563 19713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:19.482596 19713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:18:19.484043 19713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:34095
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=36425
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:19.484270 19713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:19.484475 19713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:19.489069 19736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:19.489102 19731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:19.489243 19729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:19.489270 19713 server_base.cc:1034] running on GCE node
I20260809 16:18:19.489483 19713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:19.489701 19713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:19.490851 19713 hybrid_clock.cc:648] HybridClock initialized: now 1786292299490835 us; error 26 us; skew 500 ppm
Aug 09 16:18:19 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292299, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:19.493170 19713 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:18:19.493577 19713 webserver.cc:460] Webserver started at http://127.27.217.2:36425/ using document root <none> and password file <none>
I20260809 16:18:19.493793 19713 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:19.493858 19713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:19.495139 19713 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:19.495645 19748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.495834 19713 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:19.495914 19713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "44686856ec22422396f6c07e193e55a8"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7fcc9b9784ea03b11c3afa7b4d8f0429"
server_key_iv: "c9ffeeab8ba2b5c167747b711d0d308b"
server_key_version: "encryptionkey@0"
I20260809 16:18:19.496209 19713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:19.514640 19713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:19.516319 19713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:19.516448 19713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:19.516645 19713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:19.516934 19713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:19.516973 19713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.516999 19713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:19.517022 19713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.522459 19713 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:34095
I20260809 16:18:19.522522 19930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:34095 every 8 connection(s)
I20260809 16:18:19.522818 19713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:18:19 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292299, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:19.531059 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.523428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:48367 (local address 127.27.217.62:45583)
0809 16:18:19.523494 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.523497 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.523654 (+ 157us) server_negotiation.cc:407] Connection header received
0809 16:18:19.524176 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.524178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.524191 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.524239 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:19.525127 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.525624 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.526562 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.526780 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.526835 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.528823 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:19.528824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:19.528825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:19.528832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:19.530045 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:19.530380 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:19.530381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:19.530381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:19.530433 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:19.530597 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:19.530598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:19.530598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:19.530688 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:19.530730 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.530929 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.530995 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:18:19.531185 19934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.523404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:48367)
0809 16:18:19.523547 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.523584 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.524081 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.524314 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.524318 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.524846 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:19.525035 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.525039 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.525703 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.525704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.526480 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.526482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.526847 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.526847 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.526972 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.527404 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:19.527411 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:19.528713 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:19.530116 (+ 1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:19.530122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:19.530123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:19.530326 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:19.530475 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:19.530475 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:19.530476 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:19.530558 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:19.530727 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:19.530730 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:19.530838 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.530911 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.531019 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260809 16:18:19.531646 19931 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45583
I20260809 16:18:19.531761 19931 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:19.531936 19931 heartbeater.cc:511] Master 127.27.217.62:45583 requested a full tablet report, sending...
I20260809 16:18:19.532287 19398 ts_manager.cc:194] Registered new tserver with Master: 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095)
I20260809 16:18:19.532688 19398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:48367
I20260809 16:18:19.532687 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 19713
I20260809 16:18:19.532967 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:46297
--local_ip_for_outbound_sockets=127.27.217.3
--tserver_master_addrs=127.27.217.62:45583
--webserver_port=39433
--webserver_interface=127.27.217.3
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:19.612527 19935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:19.612706 19935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:19.612727 19935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:19.613787 19935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:19.613818 19935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:19.613842 19935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:18:19.615201 19935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:46297
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=39433
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:19.615368 19935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:19.615535 19935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:19.620059 19947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:19.620184 19935 server_base.cc:1034] running on GCE node
W20260809 16:18:19.620074 19950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:19.620101 19946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:19.620467 19935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:19.620685 19935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:19.621824 19935 hybrid_clock.cc:648] HybridClock initialized: now 1786292299621808 us; error 32 us; skew 500 ppm
Aug 09 16:18:19 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292299, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:19.624189 19935 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:18:19.624554 19935 webserver.cc:460] Webserver started at http://127.27.217.3:39433/ using document root <none> and password file <none>
I20260809 16:18:19.624737 19935 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:19.624794 19935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:19.626024 19935 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:19.626513 19964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.626654 19935 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.626724 19935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "12746e30fdcb463685da4ecfacdc2148"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7f8b2bf706561853c1c76fa91e4c8f90"
server_key_iv: "2a2d331416a8a7eb73c8ce8eaeaa6810"
server_key_version: "encryptionkey@0"
I20260809 16:18:19.627025 19935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:19.645063 19935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:19.646688 19935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:19.646816 19935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:19.647019 19935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:19.647305 19935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:19.647338 19935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.647367 19935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:19.647383 19935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.652841 19935 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:46297
I20260809 16:18:19.652887 20148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:46297 every 8 connection(s)
I20260809 16:18:19.653192 19935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:18:19.658142 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 19935
Aug 09 16:18:19 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292299, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:19.661974 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.653862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:48585 (local address 127.27.217.62:45583)
0809 16:18:19.653929 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.653932 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.654100 (+ 168us) server_negotiation.cc:407] Connection header received
0809 16:18:19.654623 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.654625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.654638 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.654686 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:19.655590 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.656140 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.657066 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.657277 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.657331 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.659271 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:19.659273 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:19.659273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:19.659280 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:19.660700 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:19.661055 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:19.661056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:19.661057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:19.661116 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:19.661322 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:19.661323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:19.661324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:19.661446 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:19.661517 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.661841 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.661911 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 16:18:19.662202 20151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.653816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:48585)
0809 16:18:19.653983 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.654021 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.654519 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.654753 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.654757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.655308 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:19.655490 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.655495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.656220 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.656221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.656987 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.656989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.657343 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.657344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.657457 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.657841 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:19.657848 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:19.659187 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:19.660789 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:19.660794 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:19.660796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:19.660996 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:19.661171 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:19.661172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:19.661172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:19.661256 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:19.661518 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:19.661524 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:19.661699 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.661822 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.661976 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260809 16:18:19.662669 20149 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45583
I20260809 16:18:19.662767 20149 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:19.662931 20149 heartbeater.cc:511] Master 127.27.217.62:45583 requested a full tablet report, sending...
I20260809 16:18:19.663302 19398 ts_manager.cc:194] Registered new tserver with Master: 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
I20260809 16:18:19.663733 19398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:48585
I20260809 16:18:19.664835 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.658498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37784 (local address 127.27.217.62:45583)
0809 16:18:19.658613 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.658615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.658626 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:18:19.658697 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.658698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.658709 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.658769 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:19.659321 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.659940 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.660929 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.661161 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.661213 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.662477 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:19.662497 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:19.662498 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:19.662505 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:19.663936 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:19.664286 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:19.664286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:19.664286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:19.664336 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:19.664506 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:19.664506 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:19.664507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:19.664590 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:19.664697 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.664722 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.664776 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":69,"threads_started":1}
I20260809 16:18:19.665395 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:18:19.667649 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.665664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37794 (local address 127.27.217.62:45583)
0809 16:18:19.665715 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.665716 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.665830 (+ 114us) server_negotiation.cc:407] Connection header received
0809 16:18:19.665875 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.665876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.665905 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.665956 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:18:19.666020 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.666437 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.667090 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.667263 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.667302 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.667392 (+ 90us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:18:19.667521 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:18:19.667574 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.667591 (+ 17us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.667607 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 16:18:19.667932 19398 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:37794:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:18:19.669510 19398 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:18:19.671597 19586 tablet_service.cc:1467] Processing CreateTablet for tablet 90588d50a5eb4d6db81dd4e62bf67632 (DEFAULT_TABLE table=test-table [id=d74bbf148e8d4d16afb998a66dc5e857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:19.671792 19586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90588d50a5eb4d6db81dd4e62bf67632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:19.673029 19524 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Bootstrap starting.
I20260809 16:18:19.673357 19524 tablet_bootstrap.cc:654] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:19.673884 19524 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: No bootstrap required, opened a new log
I20260809 16:18:19.673930 19524 ts_tablet_manager.cc:1397] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 16:18:19.674027 19524 raft_consensus.cc:348] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.674094 19524 raft_consensus.cc:374] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:19.674144 19524 raft_consensus.cc:729] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3956af4054c4067a7b78d090f564e9c, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.674191 19524 consensus_queue.cc:260] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.674280 19524 ts_tablet_manager.cc:1428] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.675029 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.671202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46297 (local address 127.0.0.1:39758)
0809 16:18:19.671398 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.671406 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.671445 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.671708 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.671709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.671712 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.671750 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.671752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.673004 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.673005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.673822 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.673824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.674791 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.674791 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.674853 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.674856 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.674927 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.674964 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":83,"threads_started":1}
I20260809 16:18:19.675050 20163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.671385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39758 (local address 127.27.217.3:46297)
0809 16:18:19.671535 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.671539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.671548 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:18:19.671580 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.671582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.671596 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.671691 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.671812 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.672896 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.673954 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.674635 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.674680 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.674734 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.674947 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.674984 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260809 16:18:19.675213 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.671139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34095 (local address 127.0.0.1:38074)
0809 16:18:19.671187 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.671197 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.671240 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.671729 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.671730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.671731 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.671769 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.671770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.673053 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.673054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.674023 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.674026 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.675011 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.675012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.675073 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.675077 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.675104 (+ 27us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.675147 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 16:18:19.675606 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.671232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38074 (local address 127.27.217.2:34095)
0809 16:18:19.671544 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.671547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.671556 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:18:19.671591 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.671593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.671607 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.671835 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.671906 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.672951 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.674122 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.674912 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.675396 (+ 484us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.675463 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.675488 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.675527 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":85,"threads_started":1}
I20260809 16:18:19.675825 20039 tablet_service.cc:1467] Processing CreateTablet for tablet 90588d50a5eb4d6db81dd4e62bf67632 (DEFAULT_TABLE table=test-table [id=d74bbf148e8d4d16afb998a66dc5e857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:19.676172 20039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90588d50a5eb4d6db81dd4e62bf67632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:19.676247 19824 tablet_service.cc:1467] Processing CreateTablet for tablet 90588d50a5eb4d6db81dd4e62bf67632 (DEFAULT_TABLE table=test-table [id=d74bbf148e8d4d16afb998a66dc5e857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:19.676564 19824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90588d50a5eb4d6db81dd4e62bf67632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:19.679564 20165 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: Bootstrap starting.
I20260809 16:18:19.680601 20165 tablet_bootstrap.cc:654] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:19.680797 20166 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: Bootstrap starting.
I20260809 16:18:19.681203 20165 log.cc:824] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:19.681411 20166 tablet_bootstrap.cc:654] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:19.681905 20166 log.cc:824] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:19.681983 20165 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: No bootstrap required, opened a new log
I20260809 16:18:19.682045 20165 ts_tablet_manager.cc:1397] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 16:18:19.683316 20165 raft_consensus.cc:348] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.683436 20165 raft_consensus.cc:374] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:19.683456 20165 raft_consensus.cc:729] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12746e30fdcb463685da4ecfacdc2148, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.683537 20165 consensus_queue.cc:260] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.683776 20165 ts_tablet_manager.cc:1428] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:18:19.683776 20149 heartbeater.cc:503] Master 127.27.217.62:45583 was elected leader, sending a full tablet report...
I20260809 16:18:19.684389 20166 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: No bootstrap required, opened a new log
I20260809 16:18:19.684470 20166 ts_tablet_manager.cc:1397] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 16:18:19.685822 20166 raft_consensus.cc:348] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.685966 20166 raft_consensus.cc:374] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:19.686004 20166 raft_consensus.cc:729] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44686856ec22422396f6c07e193e55a8, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.686107 20166 consensus_queue.cc:260] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.686353 20166 ts_tablet_manager.cc:1428] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:18:19.686379 19931 heartbeater.cc:503] Master 127.27.217.62:45583 was elected leader, sending a full tablet report...
I20260809 16:18:19.754067 19712 raft_consensus.cc:482] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:19.754194 19712 raft_consensus.cc:504] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.754536 19712 leader_election.cc:288] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
I20260809 16:18:19.758165 20163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.754820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:35309 (local address 127.27.217.3:46297)
0809 16:18:19.754860 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.754862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.754954 (+ 92us) server_negotiation.cc:407] Connection header received
0809 16:18:19.754987 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.754987 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.754996 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.755037 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.755164 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.755842 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.757261 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.757837 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.757912 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.757919 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.758057 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.758092 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:18:19.758165 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.754776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:34433 (local address 127.27.217.2:34095)
0809 16:18:19.754822 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.754824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.754856 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:18:19.754883 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.754884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.754894 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.754937 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:19.755406 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.756042 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.757242 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.757837 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.757909 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.757918 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.758057 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.758092 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:18:19.758184 19707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.754681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34095 (local address 127.27.217.1:34433)
0809 16:18:19.754758 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.754771 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.754817 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.754949 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.754950 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.754952 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.755319 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.755321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.756110 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.756110 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.757164 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.757167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.757911 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.757913 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.757989 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.757993 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.758047 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.758087 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":3}
I20260809 16:18:19.758189 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.754688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46297 (local address 127.27.217.1:35309)
0809 16:18:19.754891 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.754898 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:19.754946 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:19.755051 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:19.755052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:19.755053 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:19.755109 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.755111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.755922 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.755923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.757164 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:19.757167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.757932 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.757933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:19.757989 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.757993 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:18:19.758047 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 16:18:19.758087 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":10,"thread_start_us":116,"threads_started":1}
I20260809 16:18:19.758531 19859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90588d50a5eb4d6db81dd4e62bf67632" candidate_uuid: "c3956af4054c4067a7b78d090f564e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44686856ec22422396f6c07e193e55a8" is_pre_election: true
I20260809 16:18:19.758688 19859 raft_consensus.cc:2454] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3956af4054c4067a7b78d090f564e9c in term 0.
I20260809 16:18:19.758906 19518 leader_election.cc:302] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44686856ec22422396f6c07e193e55a8, c3956af4054c4067a7b78d090f564e9c; no voters:
I20260809 16:18:19.758991 20070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90588d50a5eb4d6db81dd4e62bf67632" candidate_uuid: "c3956af4054c4067a7b78d090f564e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12746e30fdcb463685da4ecfacdc2148" is_pre_election: true
I20260809 16:18:19.759094 19712 raft_consensus.cc:2781] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:18:19.759145 20070 raft_consensus.cc:2454] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3956af4054c4067a7b78d090f564e9c in term 0.
I20260809 16:18:19.759169 19712 raft_consensus.cc:482] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:18:19.759195 19712 raft_consensus.cc:3037] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:19.759948 19712 raft_consensus.cc:504] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.760072 19712 leader_election.cc:288] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 1 election: Requested vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
I20260809 16:18:19.760210 20070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90588d50a5eb4d6db81dd4e62bf67632" candidate_uuid: "c3956af4054c4067a7b78d090f564e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12746e30fdcb463685da4ecfacdc2148"
I20260809 16:18:19.760232 19859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90588d50a5eb4d6db81dd4e62bf67632" candidate_uuid: "c3956af4054c4067a7b78d090f564e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44686856ec22422396f6c07e193e55a8"
I20260809 16:18:19.760291 19859 raft_consensus.cc:3037] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:19.760290 20070 raft_consensus.cc:3037] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:19.761147 19859 raft_consensus.cc:2454] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3956af4054c4067a7b78d090f564e9c in term 1.
I20260809 16:18:19.761147 20070 raft_consensus.cc:2454] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3956af4054c4067a7b78d090f564e9c in term 1.
I20260809 16:18:19.761343 19518 leader_election.cc:302] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44686856ec22422396f6c07e193e55a8, c3956af4054c4067a7b78d090f564e9c; no voters:
I20260809 16:18:19.761418 19712 raft_consensus.cc:2781] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:19.761570 19712 raft_consensus.cc:686] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 LEADER]: Becoming Leader. State: Replica: c3956af4054c4067a7b78d090f564e9c, State: Running, Role: LEADER
I20260809 16:18:19.761637 19712 consensus_queue.cc:237] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:19.762362 19398 catalog_manager.cc:5495] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c reported cstate change: term changed from 0 to 1, leader changed from <none> to c3956af4054c4067a7b78d090f564e9c (127.27.217.1). New cstate: current_term: 1 leader_uuid: "c3956af4054c4067a7b78d090f564e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } health_report { overall_health: HEALTHY } } }
I20260809 16:18:19.768985 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.766770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37960 (local address 127.27.217.1:45173)
0809 16:18:19.766810 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:19.766812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:19.766845 (+ 33us) server_negotiation.cc:407] Connection header received
0809 16:18:19.766925 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:19.766926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:19.766940 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:19.766993 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:18:19.767076 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.767550 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.768334 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:19.768511 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:19.768562 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:19.768700 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:18:19.768811 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:18:19.768867 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:19.768905 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 16:18:19.768922 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:18:19.770323 20070 raft_consensus.cc:1261] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 1 FOLLOWER]: Refusing update from remote peer c3956af4054c4067a7b78d090f564e9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:19.770336 19859 raft_consensus.cc:1261] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 1 FOLLOWER]: Refusing update from remote peer c3956af4054c4067a7b78d090f564e9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:19.770586 19712 consensus_queue.cc:1035] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:19.770715 20175 consensus_queue.cc:1035] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:19.773100 20178 mvcc.cc:205] Tried to move back new op lower bound from 7316653259857203200 to 7316653259824132096. Current Snapshot: MvccSnapshot[applied={T|T < 7316653259857203200 or (T in {7316653259857203200})}]
I20260809 16:18:19.773207 20180 mvcc.cc:205] Tried to move back new op lower bound from 7316653259857203200 to 7316653259824132096. Current Snapshot: MvccSnapshot[applied={T|T < 7316653259857203200}]
I20260809 16:18:19.773667 20179 mvcc.cc:205] Tried to move back new op lower bound from 7316653259857203200 to 7316653259824132096. Current Snapshot: MvccSnapshot[applied={T|T < 7316653259857203200 or (T in {7316653259857203200})}]
I20260809 16:18:19.775061 19396 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:37794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:19.775156 19396 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:37794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:19.775874 19396 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Sending DeleteTablet for 3 replicas of tablet 90588d50a5eb4d6db81dd4e62bf67632
I20260809 16:18:19.776175 19586 tablet_service.cc:1514] Processing DeleteTablet for tablet 90588d50a5eb4d6db81dd4e62bf67632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:19 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:37952
I20260809 16:18:19.776175 20039 tablet_service.cc:1514] Processing DeleteTablet for tablet 90588d50a5eb4d6db81dd4e62bf67632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:19 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:39758
I20260809 16:18:19.776175 19824 tablet_service.cc:1514] Processing DeleteTablet for tablet 90588d50a5eb4d6db81dd4e62bf67632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:19 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:38074
I20260809 16:18:19.776232 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 19461
I20260809 16:18:19.778749 20187 tablet_replica.cc:330] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: stopping tablet replica
I20260809 16:18:19.778841 20187 raft_consensus.cc:2229] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:19.778919 20187 raft_consensus.cc:2258] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:19.783123 20187 ts_tablet_manager.cc:1905] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:19.783839 20188 tablet_replica.cc:330] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: stopping tablet replica
I20260809 16:18:19.784026 20188 raft_consensus.cc:2229] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:19.784229 20188 raft_consensus.cc:2258] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:19.784723 20187 ts_tablet_manager.cc:1918] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:19.784803 20187 log.cc:1196] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/90588d50a5eb4d6db81dd4e62bf67632
I20260809 16:18:19.784962 20188 ts_tablet_manager.cc:1905] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:19.785079 20187 ts_tablet_manager.cc:1939] T 90588d50a5eb4d6db81dd4e62bf67632 P 12746e30fdcb463685da4ecfacdc2148: Deleting consensus metadata
I20260809 16:18:19.785490 19369 catalog_manager.cc:4841] TS 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297): tablet 90588d50a5eb4d6db81dd4e62bf67632 (table test-table [id=d74bbf148e8d4d16afb998a66dc5e857]) successfully deleted
I20260809 16:18:19.786446 20188 ts_tablet_manager.cc:1918] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:19.786518 20188 log.cc:1196] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/90588d50a5eb4d6db81dd4e62bf67632
I20260809 16:18:19.786788 20188 ts_tablet_manager.cc:1939] T 90588d50a5eb4d6db81dd4e62bf67632 P 44686856ec22422396f6c07e193e55a8: Deleting consensus metadata
I20260809 16:18:19.787151 19370 catalog_manager.cc:4841] TS 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095): tablet 90588d50a5eb4d6db81dd4e62bf67632 (table test-table [id=d74bbf148e8d4d16afb998a66dc5e857]) successfully deleted
W20260809 16:18:19.793372 19367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:45173 (error 108)
I20260809 16:18:19.793574 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 19713
I20260809 16:18:19.798671 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:19.798517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:45173 (local address 127.0.0.1:37968)
0809 16:18:19.798577 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:19.798633 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:45173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 16:18:19.798818 19367 catalog_manager.cc:4584] TS c3956af4054c4067a7b78d090f564e9c (127.27.217.1:45173): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 90588d50a5eb4d6db81dd4e62bf67632: Network error: Client connection negotiation failed: client connection to 127.27.217.1:45173: connect: Connection refused (error 111)
I20260809 16:18:19.801441 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 19935
I20260809 16:18:19.808614 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 19344
I20260809 16:18:19.816220 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45583
--webserver_interface=127.27.217.62
--webserver_port=40851
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:45583
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:19.894764 20191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:19.894948 20191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:19.894968 20191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:19.896059 20191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:19.896091 20191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:19.896106 20191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:19.896116 20191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:19.896126 20191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:19.897496 20191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:45583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=40851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:19.897673 20191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:19.897843 20191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:19.902199 20196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:19.902307 20200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:19.902390 20191 server_base.cc:1034] running on GCE node
W20260809 16:18:19.902516 20197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:19.902784 20191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:19.903043 20191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:19.904173 20191 hybrid_clock.cc:648] HybridClock initialized: now 1786292299904161 us; error 31 us; skew 500 ppm
Aug 09 16:18:19 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292299, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:19.906402 20191 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:19.906803 20191 webserver.cc:460] Webserver started at http://127.27.217.62:40851/ using document root <none> and password file <none>
I20260809 16:18:19.906988 20191 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:19.907037 20191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:19.908274 20191 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:19.908854 20213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:19.909008 20191 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:19.909101 20191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "56220355ce264e6797e23301adc547d1"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "f62708515dca33820b8d639f6348035e"
server_key_iv: "dba4c46bc9516a1afda4c20f8cd0cc48"
server_key_version: "encryptionkey@0"
I20260809 16:18:19.909386 20191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:19.922102 20191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:19.923643 20191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:19.923797 20191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:19.927525 20191 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:45583
I20260809 16:18:19.927564 20295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:45583 every 8 connection(s)
I20260809 16:18:19.927925 20191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:19.929373 20296 sys_catalog.cc:263] Verifying existing consensus state
I20260809 16:18:19.930042 20296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Bootstrap starting.
I20260809 16:18:19.930787 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 20191
I20260809 16:18:19.931061 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:45173
--local_ip_for_outbound_sockets=127.27.217.1
--tserver_master_addrs=127.27.217.62:45583
--webserver_port=40245
--webserver_interface=127.27.217.1
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:19.938200 20296 log.cc:824] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:19.940361 20296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:18:19.940625 20296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1: Bootstrap complete.
I20260809 16:18:19.942633 20296 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:19.942840 20296 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56220355ce264e6797e23301adc547d1, State: Initialized, Role: FOLLOWER
I20260809 16:18:19.942981 20296 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:19.943038 20296 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:18:19.943084 20296 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:18:19.943130 20296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 2 FOLLOWER]: Advancing to term 3
I20260809 16:18:19.944119 20296 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:19.944216 20296 leader_election.cc:302] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56220355ce264e6797e23301adc547d1; no voters:
I20260809 16:18:19.944372 20296 leader_election.cc:288] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 16:18:19.944417 20301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 16:18:19.944517 20301 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [term 3 LEADER]: Becoming Leader. State: Replica: 56220355ce264e6797e23301adc547d1, State: Running, Role: LEADER
I20260809 16:18:19.944614 20301 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } }
I20260809 16:18:19.944641 20296 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:19.945047 20301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56220355ce264e6797e23301adc547d1. Latest consensus state: current_term: 3 leader_uuid: "56220355ce264e6797e23301adc547d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } } }
I20260809 16:18:19.945125 20301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:19.945272 20303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "56220355ce264e6797e23301adc547d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56220355ce264e6797e23301adc547d1" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45583 } } }
I20260809 16:18:19.945333 20303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56220355ce264e6797e23301adc547d1 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:19.945585 20309 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:19.946377 20309 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:19.946475 20309 catalog_manager.cc:1259] Loaded cluster ID: c58b7892c5674a90a22c55c648e1d7b3
I20260809 16:18:19.946501 20309 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 16:18:19.946702 20309 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f16d646d9ad google::LogMessage::Fail() at ??:0
@ 0x7f16d647088a google::LogMessage::SendToLog() at ??:0
@ 0x7f16d646d4de google::LogMessage::Flush() at ??:0
@ 0x7f16d646ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f16de3920f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f16de39b8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f16d833b0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f16d8330954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f16d91946db start_thread at ??:0
@ 0x7f16d4f6b61f clone at ??:0
W20260809 16:18:20.039844 20298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:20.040108 20298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:20.040144 20298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:20.041814 20298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:20.041873 20298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:20.041915 20298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:18:20.044009 20298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:45173
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=40245
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:20.044261 20298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:20.044546 20298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:20.049728 20350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:20.049736 20348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:20.049785 20355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:20.050161 20298 server_base.cc:1034] running on GCE node
I20260809 16:18:20.050374 20298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:20.050603 20298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:20.051749 20298 hybrid_clock.cc:648] HybridClock initialized: now 1786292300051729 us; error 34 us; skew 500 ppm
Aug 09 16:18:20 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292300, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:20.054108 20298 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:18:20.054530 20298 webserver.cc:460] Webserver started at http://127.27.217.1:40245/ using document root <none> and password file <none>
I20260809 16:18:20.054746 20298 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:20.054805 20298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:20.056138 20298 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:18:20.056849 20368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:20.057037 20298 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:18:20.057132 20298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "c3956af4054c4067a7b78d090f564e9c"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "179f3bd6981368eff840ae1927c4fac9"
server_key_iv: "55dd03b9e0a1016eba3e56f0217384d5"
server_key_version: "encryptionkey@0"
I20260809 16:18:20.057451 20298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:20.075094 20298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:20.077137 20298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:20.077271 20298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:20.077479 20298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:20.077910 20380 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 16:18:20.079802 20298 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 16:18:20.079846 20298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 16:18:20.079878 20298 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 16:18:20.080483 20298 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 16:18:20.080514 20298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 16:18:20.080598 20380 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Bootstrap starting.
I20260809 16:18:20.087105 20298 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:45173
I20260809 16:18:20.087241 20551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:45173 every 8 connection(s)
I20260809 16:18:20.087503 20298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:18:20.091317 20380 log.cc:824] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:20.093994 20380 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:18:20.094290 20380 tablet_bootstrap.cc:492] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Bootstrap complete.
I20260809 16:18:20.095384 20380 ts_tablet_manager.cc:1397] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.011s
I20260809 16:18:20.096885 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 20298
I20260809 16:18:20.096822 20380 raft_consensus.cc:348] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:20.097153 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:34095
--local_ip_for_outbound_sockets=127.27.217.2
--tserver_master_addrs=127.27.217.62:45583
--webserver_port=36425
--webserver_interface=127.27.217.2
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:20.097152 20380 raft_consensus.cc:729] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3956af4054c4067a7b78d090f564e9c, State: Initialized, Role: FOLLOWER
I20260809 16:18:20.097313 20380 consensus_queue.cc:260] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:20.097590 20380 ts_tablet_manager.cc:1428] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c: Time spent starting tablet: real 0.002s user 0.005s sys 0.001s
W20260809 16:18:20.149132 20559 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:18:20.088202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:43339)
0809 16:18:20.088389 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.088423 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:20.088844 (+ 421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:20.148924 (+ 60080us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":113,"threads_started":1}
W20260809 16:18:20.149377 20553 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:45583 (0 consecutive failures): Network error: Failed to ping master at 127.27.217.62:45583: Client connection negotiation failed: client connection to 127.27.217.62:45583: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 16:18:20.149735 20559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:20.149612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:47243)
0809 16:18:20.149657 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.149715 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 16:18:20.150070 20559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:20.149995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:42161)
0809 16:18:20.150034 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.150055 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:18:20.150172 20553 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 16:18:20.177695 20565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:20.177873 20565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:20.177893 20565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:20.178931 20565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:20.178962 20565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:20.178987 20565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:18:20.180384 20565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:34095
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=36425
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:20.180567 20565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:20.180735 20565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:20.185495 20572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:20.185482 20574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:20.185563 20565 server_base.cc:1034] running on GCE node
W20260809 16:18:20.185459 20578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:20.185918 20565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:20.186105 20565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:20.187230 20565 hybrid_clock.cc:648] HybridClock initialized: now 1786292300187219 us; error 27 us; skew 500 ppm
Aug 09 16:18:20 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292300, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:20.189502 20565 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:18:20.189872 20565 webserver.cc:460] Webserver started at http://127.27.217.2:36425/ using document root <none> and password file <none>
I20260809 16:18:20.190066 20565 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:20.190110 20565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:20.191283 20565 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:20.191799 20594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:20.191953 20565 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:20.192031 20565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "44686856ec22422396f6c07e193e55a8"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7fcc9b9784ea03b11c3afa7b4d8f0429"
server_key_iv: "c9ffeeab8ba2b5c167747b711d0d308b"
server_key_version: "encryptionkey@0"
I20260809 16:18:20.192322 20565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:20.205039 20565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:20.206954 20565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:20.207073 20565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:20.207257 20565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:20.207527 20565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:20.207559 20565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:20.207579 20565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:20.207602 20565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:20.213171 20565 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:34095
I20260809 16:18:20.213210 20793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:34095 every 8 connection(s)
I20260809 16:18:20.213505 20565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:18:20.214430 20797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:20.214068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:51661)
0809 16:18:20.214216 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.214297 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
W20260809 16:18:20.214772 20795 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:45583 (0 consecutive failures): Network error: Failed to ping master at 127.27.217.62:45583: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
I20260809 16:18:20.214994 20797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:20.214919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:60329)
0809 16:18:20.214955 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.214978 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 16:18:20.215198 20797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:20.215141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:55759)
0809 16:18:20.215171 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.215187 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260809 16:18:20.215303 20795 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 16:18:20.215392 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 20565
I20260809 16:18:20.215600 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:46297
--local_ip_for_outbound_sockets=127.27.217.3
--tserver_master_addrs=127.27.217.62:45583
--webserver_port=39433
--webserver_interface=127.27.217.3
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:20.295008 20799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:20.295192 20799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:20.295212 20799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:20.296365 20799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:20.296406 20799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:20.296433 20799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:18:20.297827 20799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:46297
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=39433
--tserver_master_addrs=127.27.217.62:45583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:20.298043 20799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:20.298240 20799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:20.302771 20810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:20.302789 20815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:20.302778 20809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:20.303064 20799 server_base.cc:1034] running on GCE node
I20260809 16:18:20.303236 20799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:20.303460 20799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:20.304600 20799 hybrid_clock.cc:648] HybridClock initialized: now 1786292300304586 us; error 28 us; skew 500 ppm
Aug 09 16:18:20 dist-test-slave-nj21 krb5kdc[18437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292300, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:20.307331 20799 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:18:20.307837 20799 webserver.cc:460] Webserver started at http://127.27.217.3:39433/ using document root <none> and password file <none>
I20260809 16:18:20.308058 20799 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:20.308104 20799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:20.309443 20799 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:20.309998 20823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:20.310150 20799 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:20.310221 20799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "12746e30fdcb463685da4ecfacdc2148"
format_stamp: "Formatted at 2026-08-09 16:18:18 on dist-test-slave-nj21"
server_key: "7f8b2bf706561853c1c76fa91e4c8f90"
server_key_iv: "2a2d331416a8a7eb73c8ce8eaeaa6810"
server_key_version: "encryptionkey@0"
I20260809 16:18:20.310514 20799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:20.323190 20799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:20.324759 20799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:20.324890 20799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:20.325088 20799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:20.325354 20799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:20.325387 20799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:20.325413 20799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:20.325430 20799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:20.330909 20799 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:46297
I20260809 16:18:20.330945 21024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:46297 every 8 connection(s)
I20260809 16:18:20.331238 20799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:18:20.332190 21028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:20.331854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:33593)
0809 16:18:20.331990 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.332060 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
W20260809 16:18:20.332537 21025 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:45583 (0 consecutive failures): Network error: Failed to ping master at 127.27.217.62:45583: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
I20260809 16:18:20.332768 21028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:20.332690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:36343)
0809 16:18:20.332728 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.332753 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 16:18:20.332999 21028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:20.332943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:36219)
0809 16:18:20.332971 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:20.332988 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260809 16:18:20.333077 21025 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 16:18:20.340390 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 20799
I20260809 16:18:21.150698 21030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:21.150484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:43383)
0809 16:18:21.150603 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:21.150635 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260809 16:18:21.215775 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:21.215571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:58361)
0809 16:18:21.215690 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:21.215723 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":52,"threads_started":1}
I20260809 16:18:21.333524 21035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:21.333329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:56503)
0809 16:18:21.333449 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:21.333479 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
I20260809 16:18:21.699524 21036 raft_consensus.cc:482] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:21.699661 21036 raft_consensus.cc:504] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:21.700049 21036 leader_election.cc:288] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
Aug 09 16:18:21 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292300, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.3@KRBTEST.COM
Aug 09 16:18:21 dist-test-slave-nj21 krb5kdc[18437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292300, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.2@KRBTEST.COM
I20260809 16:18:21.709890 21039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:21.700283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:37073 (local address 127.27.217.2:34095)
0809 16:18:21.700465 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:21.700475 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:21.700501 (+ 26us) server_negotiation.cc:407] Connection header received
0809 16:18:21.700942 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:21.700944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:21.700996 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:21.701110 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:21.701957 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:21.702796 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:21.703904 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:21.704300 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:21.704406 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:21.706815 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:21.706818 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:21.706819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:21.706828 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:21.708419 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:21.708779 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:21.708782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:21.708782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:21.708870 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:21.709097 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:21.709098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:21.709098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:21.709314 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:21.709391 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:21.709660 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 16:18:21.709775 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":87,"threads_started":1}
I20260809 16:18:21.709894 21040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:21.700324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:34589 (local address 127.27.217.3:46297)
0809 16:18:21.700460 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:21.700472 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:21.700503 (+ 31us) server_negotiation.cc:407] Connection header received
0809 16:18:21.700999 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:21.701001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:21.701041 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:21.701175 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:21.701956 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:21.702797 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:21.703924 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:21.704301 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:21.704406 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:21.706462 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:21.706466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:21.706466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:21.706479 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:21.708353 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:21.708791 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:21.708794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:21.708794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:21.708883 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:21.709101 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:21.709102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:21.709102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:21.709320 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:21.709391 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:21.709664 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 16:18:21.709788 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":56,"threads_started":1}
I20260809 16:18:21.709893 21038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:21.700168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:46297 (local address 127.27.217.1:34589)
0809 16:18:21.700324 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:21.700335 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:21.700400 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:21.701194 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:21.701195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:21.701641 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:21.701836 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:21.701851 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:21.702895 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:21.702896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:21.703829 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:21.703832 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:21.704380 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:21.704381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:21.704491 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:21.704994 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:21.705001 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:21.706361 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:21.708432 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:21.708439 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:21.708441 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:21.708712 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:21.708945 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:21.708945 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:21.708946 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:21.709042 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:21.709384 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:21.709390 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:21.709515 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 16:18:21.709602 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 16:18:21.709779 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":62,"thread_start_us":51,"threads_started":1}
I20260809 16:18:21.709964 21037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:21.700168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:34095 (local address 127.27.217.1:37073)
0809 16:18:21.700276 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:21.700287 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:21.700347 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:21.701184 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:21.701187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:21.701641 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:21.701836 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:21.701841 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:21.702890 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:21.702891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:21.703831 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:21.703834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:21.704381 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:21.704382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:21.704491 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:21.705044 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:21.705049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:21.706722 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:21.708494 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:21.708494 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:21.708495 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:21.708711 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:21.708932 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:21.708933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:21.708934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:21.709040 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:21.709380 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:21.709386 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:21.709519 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 16:18:21.709602 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 16:18:21.709849 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":162,"thread_start_us":55,"threads_started":1}
W20260809 16:18:21.710665 20373 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
W20260809 16:18:21.710824 20374 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
I20260809 16:18:21.710882 20374 leader_election.cc:302] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3956af4054c4067a7b78d090f564e9c; no voters: 12746e30fdcb463685da4ecfacdc2148, 44686856ec22422396f6c07e193e55a8
I20260809 16:18:21.710980 21036 raft_consensus.cc:2726] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:18:22.151264 21038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:22.151129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:36541)
0809 16:18:22.151188 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:22.151221 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 16:18:22.216313 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:22.216123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:39857)
0809 16:18:22.216242 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:22.216275 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":68,"threads_started":1}
I20260809 16:18:22.334067 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:22.333892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:36011)
0809 16:18:22.334002 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:22.334033 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
I20260809 16:18:23.151870 21049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:23.151648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:53135)
0809 16:18:23.151792 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:23.151824 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260809 16:18:23.216854 21051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:23.216670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:52653)
0809 16:18:23.216782 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:23.216815 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":67,"threads_started":1}
I20260809 16:18:23.233465 21054 raft_consensus.cc:482] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:23.233553 21054 raft_consensus.cc:504] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:23.233697 21054 leader_election.cc:288] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
W20260809 16:18:23.234079 20373 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
W20260809 16:18:23.234144 20374 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
I20260809 16:18:23.234210 20374 leader_election.cc:302] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3956af4054c4067a7b78d090f564e9c; no voters: 12746e30fdcb463685da4ecfacdc2148, 44686856ec22422396f6c07e193e55a8
I20260809 16:18:23.234293 21054 raft_consensus.cc:2726] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:18:23.334659 21060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:23.334453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:35987)
0809 16:18:23.334587 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:23.334621 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260809 16:18:24.152531 21066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:24.152286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:49895)
0809 16:18:24.152445 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:24.152483 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":82,"threads_started":1}
I20260809 16:18:24.217453 21068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:24.217233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:43025)
0809 16:18:24.217373 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:24.217411 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260809 16:18:24.335196 21069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:24.335021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:57905)
0809 16:18:24.335124 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:24.335155 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":56,"threads_started":1}
I20260809 16:18:25.153209 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:25.153002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:34617)
0809 16:18:25.153126 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:25.153161 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260809 16:18:25.214804 21072 raft_consensus.cc:482] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:25.214890 21072 raft_consensus.cc:504] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:25.215027 21072 leader_election.cc:288] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
W20260809 16:18:25.215333 20374 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
W20260809 16:18:25.215415 20373 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
I20260809 16:18:25.215484 20373 leader_election.cc:302] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3956af4054c4067a7b78d090f564e9c; no voters: 12746e30fdcb463685da4ecfacdc2148, 44686856ec22422396f6c07e193e55a8
I20260809 16:18:25.215565 21072 raft_consensus.cc:2726] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:18:25.218009 21074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:25.217843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:37331)
0809 16:18:25.217944 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:25.217975 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":53,"threads_started":1}
I20260809 16:18:25.335832 21075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:25.335559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:53533)
0809 16:18:25.335719 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:25.335760 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
I20260809 16:18:26.153842 21077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:26.153640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:56137)
0809 16:18:26.153763 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:26.153796 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260809 16:18:26.218535 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:26.218359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:45891)
0809 16:18:26.218466 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:26.218497 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":58,"threads_started":1}
I20260809 16:18:26.336412 21079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:26.336209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:56501)
0809 16:18:26.336338 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:26.336373 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260809 16:18:27.154495 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:27.154295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:60833)
0809 16:18:27.154415 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:27.154445 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260809 16:18:27.219111 21082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:27.218915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:40543)
0809 16:18:27.219034 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:27.219069 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260809 16:18:27.336942 21084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:27.336755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:57779)
0809 16:18:27.336871 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:27.336903 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
I20260809 16:18:28.155185 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:28.154951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:43951)
0809 16:18:28.155107 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:28.155137 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":78,"threads_started":1}
I20260809 16:18:28.219626 21086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:28.219451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:46663)
0809 16:18:28.219553 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:28.219584 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":56,"threads_started":1}
I20260809 16:18:28.337527 21088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:28.337323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:37061)
0809 16:18:28.337454 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:28.337488 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260809 16:18:29.155941 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:29.155653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:35271)
0809 16:18:29.155855 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:29.155890 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":144,"threads_started":1}
I20260809 16:18:29.220209 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:29.220008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:52013)
0809 16:18:29.220116 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:29.220153 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":60,"threads_started":1}
I20260809 16:18:29.322106 21095 raft_consensus.cc:482] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:29.322203 21095 raft_consensus.cc:504] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:29.322366 21095 leader_election.cc:288] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
W20260809 16:18:29.322698 20374 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
W20260809 16:18:29.322779 20373 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
I20260809 16:18:29.322834 20373 leader_election.cc:302] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3956af4054c4067a7b78d090f564e9c; no voters: 12746e30fdcb463685da4ecfacdc2148, 44686856ec22422396f6c07e193e55a8
I20260809 16:18:29.322909 21095 raft_consensus.cc:2726] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:18:29.338093 21096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:29.337901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:55561)
0809 16:18:29.338006 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:29.338040 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":56,"threads_started":1}
I20260809 16:18:30.156590 21100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:30.156390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:45279)
0809 16:18:30.156510 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:30.156545 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260809 16:18:30.220824 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:30.220606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:43549)
0809 16:18:30.220750 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:30.220784 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260809 16:18:30.338634 21103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:30.338435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:38159)
0809 16:18:30.338560 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:30.338593 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260809 16:18:30.887532 21104 raft_consensus.cc:482] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:30.887622 21104 raft_consensus.cc:504] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44686856ec22422396f6c07e193e55a8" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 34095 } } peers { permanent_uuid: "12746e30fdcb463685da4ecfacdc2148" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 46297 } } peers { permanent_uuid: "c3956af4054c4067a7b78d090f564e9c" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 45173 } }
I20260809 16:18:30.887794 21104 leader_election.cc:288] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095), 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297)
W20260809 16:18:30.888136 20374 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44686856ec22422396f6c07e193e55a8 (127.27.217.2:34095): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
W20260809 16:18:30.888217 20373 leader_election.cc:341] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12746e30fdcb463685da4ecfacdc2148 (127.27.217.3:46297): Not found: Tablet not found: 90588d50a5eb4d6db81dd4e62bf67632
I20260809 16:18:30.888288 20373 leader_election.cc:302] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3956af4054c4067a7b78d090f564e9c; no voters: 12746e30fdcb463685da4ecfacdc2148, 44686856ec22422396f6c07e193e55a8
I20260809 16:18:30.888361 21104 raft_consensus.cc:2726] T 90588d50a5eb4d6db81dd4e62bf67632 P c3956af4054c4067a7b78d090f564e9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:18:31.157161 21105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:31.156967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:41781)
0809 16:18:31.157080 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:31.157115 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":64,"threads_started":1}
I20260809 16:18:31.221388 21106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:31.221197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:38983)
0809 16:18:31.221319 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:31.221349 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":64,"threads_started":1}
I20260809 16:18:31.339252 21107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:31.339045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:53307)
0809 16:18:31.339161 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:31.339199 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":65,"threads_started":1}
I20260809 16:18:32.157789 21108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:32.157547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:53841)
0809 16:18:32.157702 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:32.157740 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":88,"threads_started":1}
I20260809 16:18:32.221979 21109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:32.221789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:34745)
0809 16:18:32.221903 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:32.221938 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":68,"threads_started":1}
I20260809 16:18:32.339781 21110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:32.339603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:43877)
0809 16:18:32.339708 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:32.339741 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":58,"threads_started":1}
I20260809 16:18:33.158375 21113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:33.158171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:56887)
0809 16:18:33.158292 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:33.158325 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260809 16:18:33.222563 21114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:33.222374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:46039)
0809 16:18:33.222487 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:33.222522 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
I20260809 16:18:33.340322 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:33.340137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:56027)
0809 16:18:33.340246 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:33.340279 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
I20260809 16:18:34.159054 21117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:34.158801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:37833)
0809 16:18:34.158958 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:34.159002 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":69,"threads_started":1}
I20260809 16:18:34.223147 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:34.222942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:59775)
0809 16:18:34.223059 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:34.223096 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
I20260809 16:18:34.340850 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:34.340670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:40545)
0809 16:18:34.340774 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:34.340806 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":57,"threads_started":1}
I20260809 16:18:35.159809 21126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:35.159593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.1:33223)
0809 16:18:35.159733 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:35.159763 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":57,"threads_started":1}
I20260809 16:18:35.223790 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:35.223583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.2:53873)
0809 16:18:35.223714 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:35.223748 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":59,"threads_started":1}
I20260809 16:18:35.341429 21128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:35.341240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45583 (local address 127.27.217.3:52269)
0809 16:18:35.341359 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:35.341389 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:45583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
I20260809 16:18:35.342450 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 20298
I20260809 16:18:35.354948 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 20565
I20260809 16:18:35.365362 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 20799
2026-08-09T16:18:35Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18250 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:18:35 dist-test-slave-nj21 krb5kdc[21133](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:18:35 dist-test-slave-nj21 krb5kdc[21133](info): set up 2 sockets
Aug 09 16:18:35 dist-test-slave-nj21 krb5kdc[21133](info): commencing operation
krb5kdc: starting...
W20260809 16:18:36.501801 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:18:36 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:18:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:18:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:18:36.611413 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:43629
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:43629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:36.689612 21151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:36.689803 21151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:36.689834 21151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:36.690943 21151 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 16:18:36.690980 21151 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 16:18:36.690997 21151 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 16:18:36.691011 21151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:36.691026 21151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:36.691044 21151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:36.691067 21151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:36.691097 21151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:36.692564 21151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:43629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:43629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:36.692809 21151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:36.693012 21151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:36.697432 21163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:36.697476 21161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:36.697577 21151 server_base.cc:1034] running on GCE node
W20260809 16:18:36.697438 21159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:36.697875 21151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:36.698133 21151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:36.699277 21151 hybrid_clock.cc:648] HybridClock initialized: now 1786292316699259 us; error 30 us; skew 500 ppm
Aug 09 16:18:36 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292316, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:36.701519 21151 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:36.701912 21151 webserver.cc:460] Webserver started at http://127.27.217.62:42001/ using document root <none> and password file <none>
I20260809 16:18:36.702101 21151 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:36.702147 21151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:36.702270 21151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:36.703263 21151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "f493bdd602ce4336812116b8795ef1d4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "bd7ade57f09cc3178d38b73b7577b710"
server_key_iv: "3562da29eee40363bd29ac602d71e167"
server_key_version: "encryptionkey@0"
I20260809 16:18:36.703598 21151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "f493bdd602ce4336812116b8795ef1d4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "bd7ade57f09cc3178d38b73b7577b710"
server_key_iv: "3562da29eee40363bd29ac602d71e167"
server_key_version: "encryptionkey@0"
I20260809 16:18:36.704811 21151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:18:36.705487 21176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:36.705634 21151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:18:36.705717 21151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "f493bdd602ce4336812116b8795ef1d4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "bd7ade57f09cc3178d38b73b7577b710"
server_key_iv: "3562da29eee40363bd29ac602d71e167"
server_key_version: "encryptionkey@0"
I20260809 16:18:36.705781 21151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:36.717798 21151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:36.719333 21151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:36.719463 21151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:36.723142 21151 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:43629
I20260809 16:18:36.723181 21263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:43629 every 8 connection(s)
I20260809 16:18:36.723483 21151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:36.724280 21264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:36.725390 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 21151
I20260809 16:18:36.725514 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:18:36.725723 28516 external_mini_cluster.cc:1428] Setting key 9750f47ddab6e93da7129d115f5d9d3a
I20260809 16:18:36.726902 21264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Bootstrap starting.
I20260809 16:18:36.727545 21264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:36.727877 21264 log.cc:824] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:36.728592 21264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: No bootstrap required, opened a new log
I20260809 16:18:36.730650 21264 raft_consensus.cc:348] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:18:36.730775 21264 raft_consensus.cc:374] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:36.730796 21264 raft_consensus.cc:729] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f493bdd602ce4336812116b8795ef1d4, State: Initialized, Role: FOLLOWER
I20260809 16:18:36.730902 21264 consensus_queue.cc:260] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:18:36.730968 21264 raft_consensus.cc:388] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:18:36.730991 21264 raft_consensus.cc:482] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:18:36.731036 21264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:36.731528 21264 raft_consensus.cc:504] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:18:36.731613 21264 leader_election.cc:302] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f493bdd602ce4336812116b8795ef1d4; no voters:
I20260809 16:18:36.731796 21264 leader_election.cc:288] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:18:36.731828 21272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:36.732004 21272 raft_consensus.cc:686] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 1 LEADER]: Becoming Leader. State: Replica: f493bdd602ce4336812116b8795ef1d4, State: Running, Role: LEADER
I20260809 16:18:36.732061 21264 sys_catalog.cc:564] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:36.732136 21272 consensus_queue.cc:237] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
Aug 09 16:18:36 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:36.732863 21273 sys_catalog.cc:455] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f493bdd602ce4336812116b8795ef1d4. Latest consensus state: current_term: 1 leader_uuid: "f493bdd602ce4336812116b8795ef1d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } } }
I20260809 16:18:36.732950 21273 sys_catalog.cc:458] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:36.733180 21275 sys_catalog.cc:455] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f493bdd602ce4336812116b8795ef1d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } } }
I20260809 16:18:36.733301 21275 sys_catalog.cc:458] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: This master's current role is: LEADER
W20260809 16:18:36.733845 21294 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:18:36.733897 21294 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:18:36.733951 21284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:36.734097 21284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:36.736129 21284 catalog_manager.cc:1347] Generated new cluster ID: 0dac69667ed94ef58b9625e8f85d6c25
I20260809 16:18:36.736173 21284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:18:36.736444 21269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:36.726184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59326 (local address 127.27.217.62:43629)
0809 16:18:36.726384 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:36.726393 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:36.726431 (+ 38us) server_negotiation.cc:407] Connection header received
0809 16:18:36.726916 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:36.726925 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:36.726991 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:36.727132 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:36.727660 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:36.728942 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:36.729660 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:36.730280 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:36.730405 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:36.732789 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:36.732793 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:36.732793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:36.732805 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:36.734749 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:36.735063 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:36.735066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:36.735066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:36.735182 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:36.735383 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:36.735384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:36.735385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:36.735699 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:36.735846 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:36.736086 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 16:18:36.736234 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
I20260809 16:18:36.755116 21284 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:18:36.755610 21284 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:18:36.759493 21284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Generated new TSK 0
I20260809 16:18:36.759642 21284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:18:36.800766 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:43629
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:36.908627 21303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:36.908819 21303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:36.908840 21303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:36.909917 21303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:36.909950 21303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:36.909974 21303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:18:36.911322 21303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:36.911501 21303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:36.911700 21303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:36.916373 21317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:36.916563 21303 server_base.cc:1034] running on GCE node
W20260809 16:18:36.916383 21315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:36.916383 21314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:36.916828 21303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:36.917050 21303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:36.918177 21303 hybrid_clock.cc:648] HybridClock initialized: now 1786292316918170 us; error 27 us; skew 500 ppm
Aug 09 16:18:36 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292316, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:36.920624 21303 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:18:36.920998 21303 webserver.cc:460] Webserver started at http://127.27.217.1:35689/ using document root <none> and password file <none>
I20260809 16:18:36.921182 21303 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:36.921223 21303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:36.921351 21303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:36.922307 21303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "555ebef457054052a68bf4cebd4affd4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "c771d0263132735852aedb5e66504c89"
server_key_iv: "a473f5b16a198d7499da386c27c323c7"
server_key_version: "encryptionkey@0"
I20260809 16:18:36.922616 21303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "555ebef457054052a68bf4cebd4affd4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "c771d0263132735852aedb5e66504c89"
server_key_iv: "a473f5b16a198d7499da386c27c323c7"
server_key_version: "encryptionkey@0"
I20260809 16:18:36.923864 21303 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:18:36.924502 21334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:36.924629 21303 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:36.924721 21303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "555ebef457054052a68bf4cebd4affd4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "c771d0263132735852aedb5e66504c89"
server_key_iv: "a473f5b16a198d7499da386c27c323c7"
server_key_version: "encryptionkey@0"
I20260809 16:18:36.924777 21303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:36.943727 21303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:36.945719 21303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:36.945851 21303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:36.946053 21303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:36.946344 21303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:36.946377 21303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:36.946405 21303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:36.946429 21303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:36.951893 21303 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:37391
I20260809 16:18:36.951933 21514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:37391 every 8 connection(s)
I20260809 16:18:36.952210 21303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:18:36.956173 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 21303
I20260809 16:18:36.956265 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:18:36.956502 28516 external_mini_cluster.cc:1428] Setting key ed5bfa0c1b1859727884f1744c7a66a3
Aug 09 16:18:36 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292316, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:36.960920 21269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:36.952827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:43941 (local address 127.27.217.62:43629)
0809 16:18:36.952902 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:36.952905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:36.953038 (+ 133us) server_negotiation.cc:407] Connection header received
0809 16:18:36.953477 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:36.953478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:36.953488 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:36.953534 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:36.954364 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:36.954851 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:36.955781 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:36.955983 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:36.956040 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:36.958365 (+ 2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:36.958366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:36.958366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:36.958373 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:36.959728 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:36.960091 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:36.960092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:36.960092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:36.960155 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:36.960345 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:36.960346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:36.960346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:36.960478 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:36.960544 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:36.960744 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 16:18:36.960833 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 16:18:36.960974 21518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:36.952794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:43941)
0809 16:18:36.952931 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:36.952965 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:36.953403 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:36.953584 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:36.953588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:36.954114 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:36.954298 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:36.954303 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:36.954911 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:36.954912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:36.955706 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:36.955709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:36.956046 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:36.956047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:36.956143 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:36.956578 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:36.956588 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:36.958283 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:36.959800 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:36.959806 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:36.959808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:36.960021 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:36.960213 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:36.960213 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:36.960213 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:36.960296 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:36.960532 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:36.960535 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:36.960634 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 16:18:36.960705 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:18:36.960816 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":72,"threads_started":1}
I20260809 16:18:36.961408 21515 heartbeater.cc:347] Connected to a master server at 127.27.217.62:43629
I20260809 16:18:36.961526 21515 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:36.961717 21515 heartbeater.cc:511] Master 127.27.217.62:43629 requested a full tablet report, sending...
I20260809 16:18:36.962224 21207 ts_manager.cc:194] Registered new tserver with Master: 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391)
I20260809 16:18:36.962801 21207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:43941
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:18:36.980593 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:43629
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:37.059345 21523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:37.059532 21523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:37.059562 21523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:37.060662 21523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:37.060700 21523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:37.060734 21523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:18:37.062126 21523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:37.062357 21523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:37.062558 21523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:37.067065 21530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:37.067098 21529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:37.067124 21536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:37.067303 21523 server_base.cc:1034] running on GCE node
I20260809 16:18:37.067569 21523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:37.067813 21523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:37.068957 21523 hybrid_clock.cc:648] HybridClock initialized: now 1786292317068947 us; error 30 us; skew 500 ppm
Aug 09 16:18:37 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292317, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:37.071237 21523 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:18:37.071615 21523 webserver.cc:460] Webserver started at http://127.27.217.2:44773/ using document root <none> and password file <none>
I20260809 16:18:37.071849 21523 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:37.071897 21523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:37.072016 21523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:37.072944 21523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "12bba0e744b345ddb1d7d4a381762bfe"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "6890c59cf9cf373ed1cc6187320e0947"
server_key_iv: "e5bf7b2749526af9705f53c4ac479d81"
server_key_version: "encryptionkey@0"
I20260809 16:18:37.073248 21523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "12bba0e744b345ddb1d7d4a381762bfe"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "6890c59cf9cf373ed1cc6187320e0947"
server_key_iv: "e5bf7b2749526af9705f53c4ac479d81"
server_key_version: "encryptionkey@0"
I20260809 16:18:37.074393 21523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:18:37.075027 21547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:37.075170 21523 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:37.075253 21523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "12bba0e744b345ddb1d7d4a381762bfe"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "6890c59cf9cf373ed1cc6187320e0947"
server_key_iv: "e5bf7b2749526af9705f53c4ac479d81"
server_key_version: "encryptionkey@0"
I20260809 16:18:37.075309 21523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:37.089370 21523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:37.090932 21523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:37.091058 21523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:37.091254 21523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:37.091532 21523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:37.091565 21523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:37.091593 21523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:37.091610 21523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:37.097050 21523 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:38015
I20260809 16:18:37.097110 21746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:38015 every 8 connection(s)
I20260809 16:18:37.097364 21523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:18:37 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292317, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:37.104969 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 21523
I20260809 16:18:37.105084 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:18:37.105304 21269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.097950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:55485 (local address 127.27.217.62:43629)
0809 16:18:37.098010 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.098012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.098183 (+ 171us) server_negotiation.cc:407] Connection header received
0809 16:18:37.098618 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.098619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.098629 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.098676 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:37.099482 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.100011 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.100902 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.101081 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.101122 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.102903 (+ 1781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:37.102904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:37.102905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:37.102918 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:37.104195 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:37.104495 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:37.104495 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:37.104496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:37.104538 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:37.104703 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:37.104703 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:37.104703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:37.104809 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:37.104853 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.105173 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.105240 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:18:37.105319 28516 external_mini_cluster.cc:1428] Setting key 42baefb6d3e51d14fbe64bad1824236d
I20260809 16:18:37.105508 21750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.097921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:55485)
0809 16:18:37.098081 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:37.098113 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:37.098550 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:37.098727 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:37.098730 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:37.099245 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:37.099421 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.099425 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.100080 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.100081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.100831 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.100833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.101130 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.101131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.101218 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.101594 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:37.101601 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:37.102814 (+ 1213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:37.104250 (+ 1436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:37.104254 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:37.104256 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:37.104443 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:37.104579 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:37.104580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:37.104580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:37.104663 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:37.104869 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:37.104875 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:37.105023 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 16:18:37.105137 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 16:18:37.105289 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260809 16:18:37.106014 21747 heartbeater.cc:347] Connected to a master server at 127.27.217.62:43629
I20260809 16:18:37.106098 21747 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:37.106257 21747 heartbeater.cc:511] Master 127.27.217.62:43629 requested a full tablet report, sending...
I20260809 16:18:37.106635 21206 ts_manager.cc:194] Registered new tserver with Master: 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015)
I20260809 16:18:37.107026 21206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:55485
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:18:37.127769 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:43629
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:37.206727 21756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:37.206926 21756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:37.206949 21756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:37.208060 21756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:37.208097 21756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:37.208122 21756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:18:37.209590 21756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:37.209775 21756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:37.209960 21756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:37.214504 21762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:37.214510 21767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:37.214691 21756 server_base.cc:1034] running on GCE node
W20260809 16:18:37.214775 21764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:37.214951 21756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:37.215176 21756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:37.216306 21756 hybrid_clock.cc:648] HybridClock initialized: now 1786292317216292 us; error 26 us; skew 500 ppm
Aug 09 16:18:37 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292317, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:37.219030 21756 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:18:37.219422 21756 webserver.cc:460] Webserver started at http://127.27.217.3:41925/ using document root <none> and password file <none>
I20260809 16:18:37.219617 21756 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:37.219664 21756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:37.219812 21756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:18:37.220777 21756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "4e71027d6ca5476aa263ef503aa3cbdb"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "e00ac8f01729fc461e63e675d17f28b4"
server_key_iv: "35005df380cd67880a7ed7c3367bf2ad"
server_key_version: "encryptionkey@0"
I20260809 16:18:37.221087 21756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "4e71027d6ca5476aa263ef503aa3cbdb"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "e00ac8f01729fc461e63e675d17f28b4"
server_key_iv: "35005df380cd67880a7ed7c3367bf2ad"
server_key_version: "encryptionkey@0"
I20260809 16:18:37.222254 21756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:18:37.222906 21775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:37.223052 21756 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:37.223132 21756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "4e71027d6ca5476aa263ef503aa3cbdb"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "e00ac8f01729fc461e63e675d17f28b4"
server_key_iv: "35005df380cd67880a7ed7c3367bf2ad"
server_key_version: "encryptionkey@0"
I20260809 16:18:37.223189 21756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:37.234196 21756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:37.235795 21756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:37.235910 21756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:37.236084 21756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:37.236375 21756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:37.236424 21756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:37.236451 21756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:37.236475 21756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:37.241931 21756 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:40243
I20260809 16:18:37.242012 21968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:40243 every 8 connection(s)
I20260809 16:18:37.242256 21756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:18:37 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292317, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:37.249888 21269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.242890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:36985 (local address 127.27.217.62:43629)
0809 16:18:37.242948 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.242950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.243120 (+ 170us) server_negotiation.cc:407] Connection header received
0809 16:18:37.243566 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.243567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.243575 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.243621 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:37.244497 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.244983 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.245863 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.246034 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.246075 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.247885 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:37.247887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:37.247887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:37.247894 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:37.248906 (+ 1012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:37.249220 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:37.249221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:37.249221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:37.249269 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:37.249419 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:37.249420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:37.249420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:37.249522 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:37.249569 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.249759 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.249816 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:18:37.250033 21971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.242855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:36985)
0809 16:18:37.243009 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:37.243047 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:37.243495 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:37.243706 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:37.243710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:37.244239 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:37.244427 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.244431 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.245040 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.245040 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.245804 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.245806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.246084 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.246084 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.246180 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.246531 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:37.246538 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:37.247807 (+ 1269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:37.248966 (+ 1159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:37.248971 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:37.248973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:37.249168 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:37.249305 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:37.249305 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:37.249305 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:37.249382 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:37.249564 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:37.249566 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:37.249667 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 16:18:37.249741 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 16:18:37.249850 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260809 16:18:37.250511 21969 heartbeater.cc:347] Connected to a master server at 127.27.217.62:43629
I20260809 16:18:37.250605 21969 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:37.250767 21969 heartbeater.cc:511] Master 127.27.217.62:43629 requested a full tablet report, sending...
I20260809 16:18:37.251098 21206 ts_manager.cc:194] Registered new tserver with Master: 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243)
I20260809 16:18:37.251452 21206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:36985
I20260809 16:18:37.252246 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 21756
I20260809 16:18:37.252321 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:18:37.252490 28516 external_mini_cluster.cc:1428] Setting key ca20e2da3d03d66c3449cc5ffb55029e
I20260809 16:18:37.253228 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:18:37.259244 21269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.254425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59334 (local address 127.27.217.62:43629)
0809 16:18:37.254487 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.254489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.254559 (+ 70us) server_negotiation.cc:407] Connection header received
0809 16:18:37.254603 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.254604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.254612 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.254645 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:37.255098 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.255534 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.256241 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.256411 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.256456 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.257359 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:37.257360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:37.257360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:37.257365 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:37.258492 (+ 1127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:37.258724 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:37.258724 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:37.258724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:37.258765 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:37.258878 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:37.258878 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:37.258879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:37.258997 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:37.259067 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.259130 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.259184 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 16:18:37.260722 21206 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:18:37.262171 21206 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:18:37.267932 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.264100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:38015 (local address 127.0.0.1:59414)
0809 16:18:37.264386 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:37.264396 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:37.264448 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:37.264744 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:37.264745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:37.264747 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:37.264788 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.264790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.266034 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.266035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.266770 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.266773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.267645 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.267646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.267750 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.267765 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 16:18:37.267813 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 16:18:37.267860 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":3,"thread_start_us":86,"threads_started":1}
I20260809 16:18:37.268170 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.264282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:37391 (local address 127.0.0.1:47200)
0809 16:18:37.264944 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:37.264954 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:37.265028 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:37.265224 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:37.265224 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:37.265226 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:37.265264 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.265266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.266193 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.266194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.267246 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.267248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.267938 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.267939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.268009 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.268013 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:18:37.268066 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:18:37.268106 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":72,"threads_started":1}
I20260809 16:18:37.268193 21996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.264705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47200 (local address 127.27.217.1:37391)
0809 16:18:37.264895 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.264899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.265003 (+ 104us) server_negotiation.cc:407] Connection header received
0809 16:18:37.265126 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.265129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.265144 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.265218 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:37.265316 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.266081 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.267315 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.267860 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.267923 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.267980 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.268081 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.268123 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":88,"threads_started":1}
I20260809 16:18:37.268457 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.264428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59414 (local address 127.27.217.2:38015)
0809 16:18:37.264606 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.264610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.264619 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:18:37.264654 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.264656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.264671 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.264749 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:37.264907 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.265949 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.266863 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.267551 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.268117 (+ 566us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.268186 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.268323 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.268381 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
I20260809 16:18:37.268539 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.264099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40243 (local address 127.0.0.1:56020)
0809 16:18:37.264238 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:37.264276 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:37.264338 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:37.264532 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:37.264535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:37.264537 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:37.264597 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.264599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.265831 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.265832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.267101 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.267103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.268214 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.268215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.268395 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.268398 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:18:37.268441 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:18:37.268478 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":54,"threads_started":1}
I20260809 16:18:37.268805 21992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.264174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56020 (local address 127.27.217.3:40243)
0809 16:18:37.264306 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.264310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.264320 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:18:37.264429 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.264431 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.264446 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.264520 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:37.264665 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.265732 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.267180 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.267916 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.267976 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.268701 (+ 725us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.268723 (+ 22us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.268754 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260809 16:18:37.268863 21411 tablet_service.cc:1467] Processing CreateTablet for tablet 8eba2b4f516f4eec871de5a9a8f22822 (DEFAULT_TABLE table=test-table [id=c6a5daf333dc4ed586b3d88f8f802025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:37.269243 21411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eba2b4f516f4eec871de5a9a8f22822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:37.269218 21622 tablet_service.cc:1467] Processing CreateTablet for tablet 8eba2b4f516f4eec871de5a9a8f22822 (DEFAULT_TABLE table=test-table [id=c6a5daf333dc4ed586b3d88f8f802025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:37.269408 21861 tablet_service.cc:1467] Processing CreateTablet for tablet 8eba2b4f516f4eec871de5a9a8f22822 (DEFAULT_TABLE table=test-table [id=c6a5daf333dc4ed586b3d88f8f802025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:37.269565 21622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eba2b4f516f4eec871de5a9a8f22822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:37.269691 21861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eba2b4f516f4eec871de5a9a8f22822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:37.271711 21997 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Bootstrap starting.
I20260809 16:18:37.272421 21997 tablet_bootstrap.cc:654] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:37.272750 21998 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Bootstrap starting.
I20260809 16:18:37.273106 21997 log.cc:824] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:37.273383 21998 tablet_bootstrap.cc:654] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:37.273872 21998 log.cc:824] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:37.273907 21997 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: No bootstrap required, opened a new log
I20260809 16:18:37.273978 21997 ts_tablet_manager.cc:1397] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:37.274204 22002 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: Bootstrap starting.
I20260809 16:18:37.274564 21998 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: No bootstrap required, opened a new log
I20260809 16:18:37.274650 21998 ts_tablet_manager.cc:1397] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:18:37.274820 22002 tablet_bootstrap.cc:654] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:37.275651 22002 log.cc:824] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:37.276151 21997 raft_consensus.cc:348] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.276328 21997 raft_consensus.cc:374] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:37.276367 21997 raft_consensus.cc:729] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555ebef457054052a68bf4cebd4affd4, State: Initialized, Role: FOLLOWER
I20260809 16:18:37.276435 22002 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: No bootstrap required, opened a new log
I20260809 16:18:37.276496 22002 ts_tablet_manager.cc:1397] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:18:37.276502 21997 consensus_queue.cc:260] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.276582 21998 raft_consensus.cc:348] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.276757 21998 raft_consensus.cc:374] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:37.276777 21997 ts_tablet_manager.cc:1428] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:18:37.276801 21998 raft_consensus.cc:729] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12bba0e744b345ddb1d7d4a381762bfe, State: Initialized, Role: FOLLOWER
I20260809 16:18:37.276913 21998 consensus_queue.cc:260] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.276974 21515 heartbeater.cc:503] Master 127.27.217.62:43629 was elected leader, sending a full tablet report...
I20260809 16:18:37.277181 21998 ts_tablet_manager.cc:1428] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:18:37.277185 21747 heartbeater.cc:503] Master 127.27.217.62:43629 was elected leader, sending a full tablet report...
I20260809 16:18:37.278326 22002 raft_consensus.cc:348] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.278455 22002 raft_consensus.cc:374] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:37.278475 22002 raft_consensus.cc:729] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e71027d6ca5476aa263ef503aa3cbdb, State: Initialized, Role: FOLLOWER
I20260809 16:18:37.278545 22002 consensus_queue.cc:260] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.278729 22002 ts_tablet_manager.cc:1428] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 16:18:37.278798 21969 heartbeater.cc:503] Master 127.27.217.62:43629 was elected leader, sending a full tablet report...
W20260809 16:18:37.347949 21749 tablet.cc:2369] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:18:37.381749 22009 raft_consensus.cc:482] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:37.381878 22009 raft_consensus.cc:504] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.382273 22009 leader_election.cc:288] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243), 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391)
I20260809 16:18:37.385959 21996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.382538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:52075 (local address 127.27.217.1:37391)
0809 16:18:37.382596 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.382598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.382611 (+ 13us) server_negotiation.cc:407] Connection header received
0809 16:18:37.382641 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.382641 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.382651 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.382699 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:37.382867 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.383613 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.385021 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.385601 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.385676 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.385686 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.385838 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.385879 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 16:18:37.385983 21992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.382550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45533 (local address 127.27.217.3:40243)
0809 16:18:37.382594 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.382596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.382736 (+ 140us) server_negotiation.cc:407] Connection header received
0809 16:18:37.382813 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.382813 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.382821 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.382870 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:37.382984 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.383698 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.385018 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.385625 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.385682 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.385689 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.385861 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.385898 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:18:37.385985 21750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.382455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:37391 (local address 127.27.217.2:52075)
0809 16:18:37.382526 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:37.382539 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:37.382587 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:37.382722 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:37.382723 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:37.382724 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:37.382804 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.382806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.383705 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.383705 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.384943 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.384945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.385671 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.385672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.385763 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.385769 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 16:18:37.385824 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 16:18:37.385872 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":61}
I20260809 16:18:37.385991 22011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.382469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40243 (local address 127.27.217.2:45533)
0809 16:18:37.382661 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:37.382670 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:37.382723 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:37.382879 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:37.382880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:37.382881 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:37.382931 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.382932 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.383780 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.383781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.384942 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:37.384945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.385683 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.385685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:37.385775 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.385778 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:18:37.385824 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 16:18:37.385872 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":6,"thread_start_us":118,"threads_started":1}
I20260809 16:18:37.386346 21447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8eba2b4f516f4eec871de5a9a8f22822" candidate_uuid: "12bba0e744b345ddb1d7d4a381762bfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555ebef457054052a68bf4cebd4affd4" is_pre_election: true
I20260809 16:18:37.386396 21893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8eba2b4f516f4eec871de5a9a8f22822" candidate_uuid: "12bba0e744b345ddb1d7d4a381762bfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" is_pre_election: true
I20260809 16:18:37.386535 21893 raft_consensus.cc:2454] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12bba0e744b345ddb1d7d4a381762bfe in term 0.
I20260809 16:18:37.386535 21447 raft_consensus.cc:2454] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12bba0e744b345ddb1d7d4a381762bfe in term 0.
I20260809 16:18:37.386755 21554 leader_election.cc:302] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12bba0e744b345ddb1d7d4a381762bfe, 4e71027d6ca5476aa263ef503aa3cbdb; no voters:
I20260809 16:18:37.386914 22009 raft_consensus.cc:2781] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:18:37.386971 22009 raft_consensus.cc:482] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:18:37.386987 22009 raft_consensus.cc:3037] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:37.387773 22009 raft_consensus.cc:504] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.387881 22009 leader_election.cc:288] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [CANDIDATE]: Term 1 election: Requested vote from peers 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243), 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391)
I20260809 16:18:37.388053 21447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8eba2b4f516f4eec871de5a9a8f22822" candidate_uuid: "12bba0e744b345ddb1d7d4a381762bfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555ebef457054052a68bf4cebd4affd4"
I20260809 16:18:37.388134 21447 raft_consensus.cc:3037] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:37.388856 21447 raft_consensus.cc:2454] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12bba0e744b345ddb1d7d4a381762bfe in term 1.
I20260809 16:18:37.388962 21893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8eba2b4f516f4eec871de5a9a8f22822" candidate_uuid: "12bba0e744b345ddb1d7d4a381762bfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e71027d6ca5476aa263ef503aa3cbdb"
I20260809 16:18:37.389017 21553 leader_election.cc:302] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12bba0e744b345ddb1d7d4a381762bfe, 555ebef457054052a68bf4cebd4affd4; no voters:
I20260809 16:18:37.389047 21893 raft_consensus.cc:3037] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:37.389125 22009 raft_consensus.cc:2781] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:37.389281 22009 raft_consensus.cc:686] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 1 LEADER]: Becoming Leader. State: Replica: 12bba0e744b345ddb1d7d4a381762bfe, State: Running, Role: LEADER
I20260809 16:18:37.389375 22009 consensus_queue.cc:237] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:37.389848 21893 raft_consensus.cc:2454] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12bba0e744b345ddb1d7d4a381762bfe in term 1.
I20260809 16:18:37.390401 21206 catalog_manager.cc:5495] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe reported cstate change: term changed from 0 to 1, leader changed from <none> to 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2). New cstate: current_term: 1 leader_uuid: "12bba0e744b345ddb1d7d4a381762bfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } health_report { overall_health: UNKNOWN } } }
I20260809 16:18:37.409927 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.407782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59424 (local address 127.27.217.2:38015)
0809 16:18:37.407825 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:37.407827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:37.407835 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:18:37.407901 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:37.407902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:37.407917 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:37.407973 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:18:37.408090 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.408575 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.409348 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:37.409562 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:37.409607 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:37.409702 (+ 95us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:18:37.409793 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:18:37.409842 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:37.409857 (+ 15us) server_negotiation.cc:299] Negotiation successful
0809 16:18:37.409872 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:18:37.411590 21447 raft_consensus.cc:1261] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Refusing update from remote peer 12bba0e744b345ddb1d7d4a381762bfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:37.411590 21893 raft_consensus.cc:1261] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 FOLLOWER]: Refusing update from remote peer 12bba0e744b345ddb1d7d4a381762bfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:37.411969 22009 consensus_queue.cc:1035] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:37.412091 22012 consensus_queue.cc:1035] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:37.414242 22015 mvcc.cc:205] Tried to move back new op lower bound from 7316653332115251200 to 7316653332027441152. Current Snapshot: MvccSnapshot[applied={T|T < 7316653332115251200}]
I20260809 16:18:37.415196 22020 mvcc.cc:205] Tried to move back new op lower bound from 7316653332115251200 to 7316653332027441152. Current Snapshot: MvccSnapshot[applied={T|T < 7316653332115251200}]
I20260809 16:18:37.416479 21207 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:37.416576 21207 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:37.417255 21207 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Sending DeleteTablet for 3 replicas of tablet 8eba2b4f516f4eec871de5a9a8f22822
I20260809 16:18:37.417550 21622 tablet_service.cc:1514] Processing DeleteTablet for tablet 8eba2b4f516f4eec871de5a9a8f22822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:37 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:59414
I20260809 16:18:37.417565 21861 tablet_service.cc:1514] Processing DeleteTablet for tablet 8eba2b4f516f4eec871de5a9a8f22822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:37 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:56020
I20260809 16:18:37.417610 21411 tablet_service.cc:1514] Processing DeleteTablet for tablet 8eba2b4f516f4eec871de5a9a8f22822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:37 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:47200
I20260809 16:18:37.417788 22032 tablet_replica.cc:330] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: stopping tablet replica
I20260809 16:18:37.417855 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 21303
I20260809 16:18:37.417886 22032 raft_consensus.cc:2229] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:37.417964 22036 tablet_replica.cc:330] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: stopping tablet replica
I20260809 16:18:37.417977 22032 raft_consensus.cc:2258] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:37.418102 22036 raft_consensus.cc:2229] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:37.418224 22036 raft_consensus.cc:2258] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:37.424517 22032 ts_tablet_manager.cc:1905] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:37.426419 22032 ts_tablet_manager.cc:1918] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:37.426492 22032 log.cc:1196] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/8eba2b4f516f4eec871de5a9a8f22822
I20260809 16:18:37.427033 22032 ts_tablet_manager.cc:1939] T 8eba2b4f516f4eec871de5a9a8f22822 P 4e71027d6ca5476aa263ef503aa3cbdb: Deleting consensus metadata
I20260809 16:18:37.427783 22031 tablet_replica.cc:330] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: stopping tablet replica
I20260809 16:18:37.427886 22031 raft_consensus.cc:2229] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:18:37.427973 22031 raft_consensus.cc:2258] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:37.429101 22031 ts_tablet_manager.cc:1905] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:37.431152 22031 ts_tablet_manager.cc:1918] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:37.431229 22031 log.cc:1196] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/8eba2b4f516f4eec871de5a9a8f22822
I20260809 16:18:37.431339 21181 catalog_manager.cc:4841] TS 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243): tablet 8eba2b4f516f4eec871de5a9a8f22822 (table test-table [id=c6a5daf333dc4ed586b3d88f8f802025]) successfully deleted
I20260809 16:18:37.431499 22031 ts_tablet_manager.cc:1939] T 8eba2b4f516f4eec871de5a9a8f22822 P 12bba0e744b345ddb1d7d4a381762bfe: Deleting consensus metadata
I20260809 16:18:37.431917 21179 catalog_manager.cc:4841] TS 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015): tablet 8eba2b4f516f4eec871de5a9a8f22822 (table test-table [id=c6a5daf333dc4ed586b3d88f8f802025]) successfully deleted
W20260809 16:18:37.434758 21179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:37391 (error 108)
I20260809 16:18:37.435099 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 21523
I20260809 16:18:37.435283 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:37.435133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:37391 (local address 127.0.0.1:47208)
0809 16:18:37.435208 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:37.435250 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:37391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 16:18:37.436549 21179 catalog_manager.cc:4584] TS 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8eba2b4f516f4eec871de5a9a8f22822: Network error: Client connection negotiation failed: client connection to 127.27.217.1:37391: connect: Connection refused (error 111)
I20260809 16:18:37.447721 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 21756
I20260809 16:18:37.455749 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 21151
I20260809 16:18:57.463837 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:43629
--webserver_interface=127.27.217.62
--webserver_port=42001
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:43629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:18:57.545588 22042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:57.545792 22042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:57.545822 22042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:57.546906 22042 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 16:18:57.546941 22042 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 16:18:57.546958 22042 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 16:18:57.546972 22042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:18:57.546988 22042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:57.547014 22042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:57.547037 22042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:18:57.547053 22042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:18:57.548548 22042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:43629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:43629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=42001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:57.548802 22042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:57.549001 22042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:57.557844 22052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:57.557868 22049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:57.557866 22050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:57.557904 22042 server_base.cc:1034] running on GCE node
I20260809 16:18:57.558341 22042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:57.558621 22042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:57.559722 22042 hybrid_clock.cc:648] HybridClock initialized: now 1786292337559700 us; error 36 us; skew 500 ppm
Aug 09 16:18:57 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292337, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:57.562086 22042 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:18:57.562522 22042 webserver.cc:460] Webserver started at http://127.27.217.62:42001/ using document root <none> and password file <none>
I20260809 16:18:57.562721 22042 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:57.562783 22042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:57.564065 22042 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:18:57.564651 22068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.564801 22042 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:18:57.564901 22042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "f493bdd602ce4336812116b8795ef1d4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "bd7ade57f09cc3178d38b73b7577b710"
server_key_iv: "3562da29eee40363bd29ac602d71e167"
server_key_version: "encryptionkey@0"
I20260809 16:18:57.565253 22042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:57.584453 22042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:57.586432 22042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:57.586560 22042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:57.590531 22042 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:43629
I20260809 16:18:57.590566 22143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:43629 every 8 connection(s)
I20260809 16:18:57.590912 22042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:18:57.592370 22145 sys_catalog.cc:263] Verifying existing consensus state
I20260809 16:18:57.592975 22145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Bootstrap starting.
I20260809 16:18:57.599850 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 22042
I20260809 16:18:57.600204 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:37391
--local_ip_for_outbound_sockets=127.27.217.1
--tserver_master_addrs=127.27.217.62:43629
--webserver_port=35689
--webserver_interface=127.27.217.1
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:57.601553 22145 log.cc:824] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:57.603391 22145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:18:57.603655 22145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Bootstrap complete.
I20260809 16:18:57.605777 22145 raft_consensus.cc:348] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:18:57.606002 22145 raft_consensus.cc:729] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f493bdd602ce4336812116b8795ef1d4, State: Initialized, Role: FOLLOWER
I20260809 16:18:57.606141 22145 consensus_queue.cc:260] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:18:57.606205 22145 raft_consensus.cc:388] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:18:57.606257 22145 raft_consensus.cc:482] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:18:57.606303 22145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 1 FOLLOWER]: Advancing to term 2
I20260809 16:18:57.607256 22145 raft_consensus.cc:504] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:18:57.607340 22145 leader_election.cc:302] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f493bdd602ce4336812116b8795ef1d4; no voters:
I20260809 16:18:57.607481 22145 leader_election.cc:288] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 16:18:57.607532 22151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 16:18:57.607702 22151 raft_consensus.cc:686] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 2 LEADER]: Becoming Leader. State: Replica: f493bdd602ce4336812116b8795ef1d4, State: Running, Role: LEADER
I20260809 16:18:57.607762 22145 sys_catalog.cc:564] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:18:57.607795 22151 consensus_queue.cc:237] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:18:57.608060 22151 sys_catalog.cc:455] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f493bdd602ce4336812116b8795ef1d4. Latest consensus state: current_term: 2 leader_uuid: "f493bdd602ce4336812116b8795ef1d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } } }
I20260809 16:18:57.608139 22151 sys_catalog.cc:458] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:57.608337 22157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:18:57.608067 22153 sys_catalog.cc:455] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f493bdd602ce4336812116b8795ef1d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } } }
I20260809 16:18:57.608655 22153 sys_catalog.cc:458] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: This master's current role is: LEADER
I20260809 16:18:57.609138 22157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:18:57.609242 22157 catalog_manager.cc:1259] Loaded cluster ID: 0dac69667ed94ef58b9625e8f85d6c25
I20260809 16:18:57.609279 22157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:18:57.610545 22157 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:18:57.610718 22157 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Loaded TSK: 0
I20260809 16:18:57.624526 22157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Generated new TSK 1
I20260809 16:18:57.624629 22157 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 16:18:57.685321 22150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:57.685503 22150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:57.685524 22150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:57.686594 22150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:57.686628 22150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:57.686651 22150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:18:57.688071 22150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:37391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=35689
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:57.688284 22150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:57.688488 22150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:57.694276 22187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:57.694262 22189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:57.694435 22150 server_base.cc:1034] running on GCE node
W20260809 16:18:57.694486 22192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:57.694681 22150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:57.694926 22150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:57.696070 22150 hybrid_clock.cc:648] HybridClock initialized: now 1786292337696053 us; error 31 us; skew 500 ppm
Aug 09 16:18:57 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292337, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:57.698398 22150 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:18:57.698825 22150 webserver.cc:460] Webserver started at http://127.27.217.1:35689/ using document root <none> and password file <none>
I20260809 16:18:57.699039 22150 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:57.699096 22150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:57.700436 22150 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:57.701078 22200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.701265 22150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:57.701357 22150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "555ebef457054052a68bf4cebd4affd4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "c771d0263132735852aedb5e66504c89"
server_key_iv: "a473f5b16a198d7499da386c27c323c7"
server_key_version: "encryptionkey@0"
I20260809 16:18:57.701676 22150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:57.720505 22150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:57.722591 22150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:57.722733 22150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:57.722967 22150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:57.723395 22210 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 16:18:57.725222 22150 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 16:18:57.725275 22150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 16:18:57.725310 22150 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 16:18:57.725960 22150 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 16:18:57.725991 22150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 16:18:57.726068 22210 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Bootstrap starting.
I20260809 16:18:57.732903 22150 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:37391
I20260809 16:18:57.733063 22376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:37391 every 8 connection(s)
I20260809 16:18:57.733312 22150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:18:57.735905 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 22150
I20260809 16:18:57.736230 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:38015
--local_ip_for_outbound_sockets=127.27.217.2
--tserver_master_addrs=127.27.217.62:43629
--webserver_port=44773
--webserver_interface=127.27.217.2
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:57.737200 22210 log.cc:824] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:57.739566 22210 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:18:57.739873 22210 tablet_bootstrap.cc:492] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Bootstrap complete.
I20260809 16:18:57.741011 22210 ts_tablet_manager.cc:1397] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.009s
I20260809 16:18:57.742296 22210 raft_consensus.cc:348] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:57.742599 22210 raft_consensus.cc:729] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555ebef457054052a68bf4cebd4affd4, State: Initialized, Role: FOLLOWER
I20260809 16:18:57.742748 22210 consensus_queue.cc:260] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:57.742982 22210 ts_tablet_manager.cc:1428] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 09 16:18:57 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292337, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:57.747340 22381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.733957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:54067)
0809 16:18:57.735835 (+ 1878us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:57.735893 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:57.736786 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:57.737478 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:57.737482 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:57.737837 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:57.738126 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:57.738132 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.739263 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.739264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:57.740501 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:57.740504 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.741224 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.741226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:57.741367 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.741934 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:57.741944 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:57.743723 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:57.745900 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:57.745906 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:57.745908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:57.746122 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:57.746386 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:57.746386 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:57.746386 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:57.746471 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:57.746909 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:57.746912 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:57.747013 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 16:18:57.747082 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 16:18:57.747202 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1826,"thread_start_us":96,"threads_started":1}
I20260809 16:18:57.747519 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.734050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:54067 (local address 127.27.217.62:43629)
0809 16:18:57.737014 (+ 2964us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:57.737023 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:57.737061 (+ 38us) server_negotiation.cc:407] Connection header received
0809 16:18:57.737185 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:57.737190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:57.737244 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:57.738235 (+ 991us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:57.738303 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.739137 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.740618 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.741071 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.741170 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.743854 (+ 2684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:57.743859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:57.743860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:57.743873 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:57.745800 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.746207 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.746210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.746211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.746327 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.746533 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.746534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.746534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.746843 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:57.746931 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:57.747179 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 16:18:57.747321 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2909,"thread_start_us":80,"threads_started":1}
I20260809 16:18:57.748160 22378 heartbeater.cc:347] Connected to a master server at 127.27.217.62:43629
I20260809 16:18:57.748260 22378 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:57.748456 22378 heartbeater.cc:511] Master 127.27.217.62:43629 requested a full tablet report, sending...
I20260809 16:18:57.749178 22095 ts_manager.cc:194] Registered new tserver with Master: 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391)
I20260809 16:18:57.750140 22095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:54067
I20260809 16:18:57.751087 22378 heartbeater.cc:503] Master 127.27.217.62:43629 was elected leader, sending a full tablet report...
Aug 09 16:18:57 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292337, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.1@KRBTEST.COM
I20260809 16:18:57.757483 22392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.749827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54102 (local address 127.27.217.1:37391)
0809 16:18:57.750623 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:57.750626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:57.750633 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:18:57.750659 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:57.750660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:57.750671 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:57.750729 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:57.751149 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.751918 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.752660 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.752936 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.752993 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.755034 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:57.755040 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:57.755041 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:57.755046 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:57.756408 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.756813 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.756815 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.756815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.756863 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.757023 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.757024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.757024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.757139 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:57.757196 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:57.757349 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 16:18:57.757420 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":83,"threads_started":1}
I20260809 16:18:57.757544 22391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.749743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:37391 (local address 127.0.0.1:54102)
0809 16:18:57.750391 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:57.750436 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:57.750509 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:57.750743 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:57.750749 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:57.751032 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:57.751078 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:57.751080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.751982 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.751983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:57.752587 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:57.752589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.753000 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.753001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:57.753077 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.753513 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:57.753517 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:57.754962 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:57.756488 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:57.756495 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:57.756497 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:57.756746 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:57.756914 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:57.756914 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:57.756914 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:57.756974 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:57.757190 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:57.757195 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:57.757244 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 16:18:57.757323 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 16:18:57.757442 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":86,"threads_started":1}
I20260809 16:18:57.758212 22279 tablet_service.cc:1514] Processing DeleteTablet for tablet 8eba2b4f516f4eec871de5a9a8f22822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:37 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:54102
I20260809 16:18:57.758791 22394 tablet_replica.cc:330] stopping tablet replica
I20260809 16:18:57.758883 22394 raft_consensus.cc:2229] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:57.758958 22394 raft_consensus.cc:2258] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:57.759235 22394 ts_tablet_manager.cc:1905] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:57.761345 22394 ts_tablet_manager.cc:1918] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:57.761404 22394 log.cc:1196] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal/wals/8eba2b4f516f4eec871de5a9a8f22822
I20260809 16:18:57.761591 22394 ts_tablet_manager.cc:1939] T 8eba2b4f516f4eec871de5a9a8f22822 P 555ebef457054052a68bf4cebd4affd4: Deleting consensus metadata
I20260809 16:18:57.762096 22071 catalog_manager.cc:4841] TS 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391): tablet 8eba2b4f516f4eec871de5a9a8f22822 (table test-table [id=c6a5daf333dc4ed586b3d88f8f802025]) successfully deleted
W20260809 16:18:57.823737 22386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:57.823918 22386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:57.823939 22386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:57.825006 22386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:57.825037 22386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:57.825062 22386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:18:57.826453 22386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:38015
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=44773
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:57.826633 22386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:57.826804 22386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:57.831460 22405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:57.831503 22386 server_base.cc:1034] running on GCE node
W20260809 16:18:57.831509 22404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:57.831461 22408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:57.831884 22386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:57.832075 22386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:57.833204 22386 hybrid_clock.cc:648] HybridClock initialized: now 1786292337833191 us; error 30 us; skew 500 ppm
Aug 09 16:18:57 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292337, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:57.835551 22386 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:18:57.835989 22386 webserver.cc:460] Webserver started at http://127.27.217.2:44773/ using document root <none> and password file <none>
I20260809 16:18:57.836196 22386 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:57.836259 22386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:57.837477 22386 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:57.837991 22416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.838130 22386 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:18:57.838210 22386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "12bba0e744b345ddb1d7d4a381762bfe"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "6890c59cf9cf373ed1cc6187320e0947"
server_key_iv: "e5bf7b2749526af9705f53c4ac479d81"
server_key_version: "encryptionkey@0"
I20260809 16:18:57.838505 22386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:57.848302 22386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:57.850212 22386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:57.850349 22386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:57.850536 22386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:57.850800 22386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:57.850833 22386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.850860 22386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:57.850883 22386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.856617 22386 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:38015
I20260809 16:18:57.856654 22584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:38015 every 8 connection(s)
I20260809 16:18:57.856950 22386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:18:57 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292337, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:57.864658 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 22386
I20260809 16:18:57.864959 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:40243
--local_ip_for_outbound_sockets=127.27.217.3
--tserver_master_addrs=127.27.217.62:43629
--webserver_port=41925
--webserver_interface=127.27.217.3
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:18:57.865330 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.857589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:37863 (local address 127.27.217.62:43629)
0809 16:18:57.857647 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:57.857649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:57.857837 (+ 188us) server_negotiation.cc:407] Connection header received
0809 16:18:57.858308 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:57.858310 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:57.858326 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:57.858376 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:57.859236 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.859791 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.860727 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.860952 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.861008 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.862858 (+ 1850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:57.862859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:57.862860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:57.862867 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:57.863974 (+ 1107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.864325 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.864326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.864327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.864382 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.864658 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.864660 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.864660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.864802 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:57.864865 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:57.865175 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 16:18:57.865262 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:18:57.865501 22587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.857566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:37863)
0809 16:18:57.857724 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:57.857762 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:57.858211 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:57.858439 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:57.858443 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:57.858967 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:57.859146 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:57.859151 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.859865 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.859866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:57.860644 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:57.860646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.861021 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.861022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:57.861132 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.861525 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:57.861533 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:57.862767 (+ 1234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:57.864042 (+ 1275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:57.864048 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:57.864050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:57.864260 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:57.864435 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:57.864436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:57.864436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:57.864577 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:57.864857 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:57.864864 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:57.865011 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 16:18:57.865153 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 16:18:57.865309 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260809 16:18:57.865988 22585 heartbeater.cc:347] Connected to a master server at 127.27.217.62:43629
I20260809 16:18:57.866079 22585 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:57.866247 22585 heartbeater.cc:511] Master 127.27.217.62:43629 requested a full tablet report, sending...
I20260809 16:18:57.866642 22095 ts_manager.cc:194] Registered new tserver with Master: 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015)
I20260809 16:18:57.866997 22095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:37863
W20260809 16:18:57.944766 22588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:18:57.944949 22588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:18:57.944980 22588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:18:57.946058 22588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:18:57.946096 22588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:18:57.946130 22588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:18:57.947506 22588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:40243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=41925
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:18:57.947759 22588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:18:57.947960 22588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:18:57.952586 22600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:18:57.952569 22604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:57.952651 22588 server_base.cc:1034] running on GCE node
W20260809 16:18:57.952570 22599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:18:57.952931 22588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:18:57.953117 22588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:18:57.954239 22588 hybrid_clock.cc:648] HybridClock initialized: now 1786292337954225 us; error 30 us; skew 500 ppm
Aug 09 16:18:57 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292337, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:18:57.956610 22588 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:18:57.957021 22588 webserver.cc:460] Webserver started at http://127.27.217.3:41925/ using document root <none> and password file <none>
I20260809 16:18:57.957219 22588 fs_manager.cc:359] Metadata directory not provided
I20260809 16:18:57.957283 22588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:18:57.958560 22588 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:18:57.959062 22611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.959218 22588 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.959300 22588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "4e71027d6ca5476aa263ef503aa3cbdb"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "e00ac8f01729fc461e63e675d17f28b4"
server_key_iv: "35005df380cd67880a7ed7c3367bf2ad"
server_key_version: "encryptionkey@0"
I20260809 16:18:57.959592 22588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:18:57.972425 22588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:18:57.974329 22588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:18:57.974471 22588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:18:57.974659 22588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:18:57.974926 22588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:18:57.974959 22588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.974987 22588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:18:57.975009 22588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:18:57.980520 22588 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:40243
I20260809 16:18:57.980576 22782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:40243 every 8 connection(s)
I20260809 16:18:57.980859 22588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:18:57 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292337, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:18:57.989151 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.981505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:34707 (local address 127.27.217.62:43629)
0809 16:18:57.981562 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:57.981565 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:57.981755 (+ 190us) server_negotiation.cc:407] Connection header received
0809 16:18:57.982208 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:57.982209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:57.982218 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:57.982270 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:57.983091 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.983560 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.984543 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.984777 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.984840 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.986876 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:57.986878 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:57.986878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:57.986885 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:57.988059 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.988444 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.988444 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.988445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.988489 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.988661 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.988662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.988662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.988750 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:57.988794 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:57.989012 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 16:18:57.989081 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:18:57.989259 22785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.981485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:34707)
0809 16:18:57.981638 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:57.981677 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:57.982134 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:57.982319 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:57.982322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:57.982844 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:18:57.983025 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:57.983030 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.983618 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.983618 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:57.984450 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:57.984453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.984849 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.984849 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:57.984950 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.985397 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:18:57.985405 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:18:57.986789 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:18:57.988133 (+ 1344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:57.988138 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:57.988140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:57.988380 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:57.988532 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:18:57.988532 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:18:57.988533 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:18:57.988622 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:18:57.988792 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:18:57.988795 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:18:57.988899 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 16:18:57.988974 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 16:18:57.989084 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260809 16:18:57.989712 22783 heartbeater.cc:347] Connected to a master server at 127.27.217.62:43629
I20260809 16:18:57.989796 22783 heartbeater.cc:464] Registering TS with master...
I20260809 16:18:57.989928 22783 heartbeater.cc:511] Master 127.27.217.62:43629 requested a full tablet report, sending...
I20260809 16:18:57.990303 22095 ts_manager.cc:194] Registered new tserver with Master: 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243)
I20260809 16:18:57.990409 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 22588
I20260809 16:18:57.990686 22095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:34707
I20260809 16:18:57.996241 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.990773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44310 (local address 127.27.217.62:43629)
0809 16:18:57.990841 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:57.990843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:57.990991 (+ 148us) server_negotiation.cc:407] Connection header received
0809 16:18:57.991033 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:57.991034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:57.991045 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:57.991094 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:57.991823 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.992283 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.993017 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.993190 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.993247 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.994254 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:57.994255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:57.994255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:57.994260 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:57.995255 (+ 995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.995593 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.995595 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.995595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.995658 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:57.995881 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:57.995881 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:57.995882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:57.995979 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:57.996099 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:57.996126 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 16:18:57.996184 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 16:18:57.996901 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:18:57.999107 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:57.997217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44316 (local address 127.27.217.62:43629)
0809 16:18:57.997262 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:57.997264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:57.997368 (+ 104us) server_negotiation.cc:407] Connection header received
0809 16:18:57.997419 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:57.997420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:57.997448 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:57.997500 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:18:57.997573 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.997984 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.998612 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:57.998770 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:57.998809 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:57.998903 (+ 94us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:18:57.998980 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:18:57.999030 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:57.999042 (+ 12us) server_negotiation.cc:299] Negotiation successful
0809 16:18:57.999054 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:18:57.999377 22095 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:44316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:18:58.000912 22095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:18:58.002856 22279 tablet_service.cc:1467] Processing CreateTablet for tablet 4a4582ed5edc4298b277fb3768cf302a (DEFAULT_TABLE table=test-table [id=67af373e043a409cba8a5701b65a58b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:58.003059 22279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a4582ed5edc4298b277fb3768cf302a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:58.004511 22210 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Bootstrap starting.
I20260809 16:18:58.004839 22210 tablet_bootstrap.cc:654] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:58.005319 22210 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: No bootstrap required, opened a new log
I20260809 16:18:58.005367 22210 ts_tablet_manager.cc:1397] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 16:18:58.005707 22210 raft_consensus.cc:348] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.005800 22210 raft_consensus.cc:374] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:58.005854 22210 raft_consensus.cc:729] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555ebef457054052a68bf4cebd4affd4, State: Initialized, Role: FOLLOWER
I20260809 16:18:58.005900 22210 consensus_queue.cc:260] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.005996 22210 ts_tablet_manager.cc:1428] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 16:18:58.006713 22788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.002518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:38015 (local address 127.0.0.1:60216)
0809 16:18:58.002659 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:58.002667 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:58.002701 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:58.003049 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:58.003050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:58.003052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:58.003095 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:58.003096 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.004575 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.004576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:58.005610 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:58.005612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.006491 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.006492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:58.006537 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.006553 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 16:18:58.006605 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 16:18:58.006643 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":47,"threads_started":1}
I20260809 16:18:58.006774 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.002626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60216 (local address 127.27.217.2:38015)
0809 16:18:58.002815 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:58.002819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:58.002830 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:18:58.002869 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:58.002871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:58.002886 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:58.002966 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:58.003243 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.004501 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.005707 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.006417 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.006489 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.006544 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:58.006658 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 16:18:58.006700 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":104,"threads_started":1}
I20260809 16:18:58.007064 22391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.002508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40243 (local address 127.0.0.1:42132)
0809 16:18:58.002553 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:58.002561 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:58.002594 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:58.003100 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:58.003102 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:58.003104 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:58.003147 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:58.003148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.004420 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.004421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:58.005826 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:58.005829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.006821 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.006822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:58.006900 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.006903 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:18:58.006958 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 16:18:58.007004 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":236}
I20260809 16:18:58.007259 22797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.002809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42132 (local address 127.27.217.3:40243)
0809 16:18:58.002951 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:58.002956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:58.002965 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:18:58.003004 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:58.003006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:58.003019 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:58.003101 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:58.003204 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.004327 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.006086 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.006745 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.006822 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.006879 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:58.007146 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 16:18:58.007190 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260809 16:18:58.007865 22688 tablet_service.cc:1467] Processing CreateTablet for tablet 4a4582ed5edc4298b277fb3768cf302a (DEFAULT_TABLE table=test-table [id=67af373e043a409cba8a5701b65a58b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:58.007870 22485 tablet_service.cc:1467] Processing CreateTablet for tablet 4a4582ed5edc4298b277fb3768cf302a (DEFAULT_TABLE table=test-table [id=67af373e043a409cba8a5701b65a58b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:18:58.008188 22688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a4582ed5edc4298b277fb3768cf302a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:58.008199 22485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a4582ed5edc4298b277fb3768cf302a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:18:58.010870 22801 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: Bootstrap starting.
I20260809 16:18:58.011423 22801 tablet_bootstrap.cc:654] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:58.011931 22801 log.cc:824] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:58.012218 22800 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Bootstrap starting.
I20260809 16:18:58.012622 22801 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: No bootstrap required, opened a new log
I20260809 16:18:58.012689 22801 ts_tablet_manager.cc:1397] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 16:18:58.013108 22800 tablet_bootstrap.cc:654] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Neither blocks nor log segments found. Creating new log.
I20260809 16:18:58.014559 22801 raft_consensus.cc:348] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.014731 22801 raft_consensus.cc:374] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:58.014765 22801 raft_consensus.cc:729] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e71027d6ca5476aa263ef503aa3cbdb, State: Initialized, Role: FOLLOWER
I20260809 16:18:58.014889 22801 consensus_queue.cc:260] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.015172 22801 ts_tablet_manager.cc:1428] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 16:18:58.015304 22783 heartbeater.cc:503] Master 127.27.217.62:43629 was elected leader, sending a full tablet report...
I20260809 16:18:58.015847 22800 log.cc:824] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Log is configured to *not* fsync() on all Append() calls
I20260809 16:18:58.016729 22800 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: No bootstrap required, opened a new log
I20260809 16:18:58.016803 22800 ts_tablet_manager.cc:1397] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 16:18:58.018728 22800 raft_consensus.cc:348] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.018898 22800 raft_consensus.cc:374] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:18:58.018945 22800 raft_consensus.cc:729] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12bba0e744b345ddb1d7d4a381762bfe, State: Initialized, Role: FOLLOWER
I20260809 16:18:58.019063 22800 consensus_queue.cc:260] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.019340 22585 heartbeater.cc:503] Master 127.27.217.62:43629 was elected leader, sending a full tablet report...
I20260809 16:18:58.019423 22800 ts_tablet_manager.cc:1428] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:18:58.072918 22804 raft_consensus.cc:482] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:18:58.073065 22804 raft_consensus.cc:504] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.073429 22804 leader_election.cc:288] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015), 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391)
I20260809 16:18:58.076318 22785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.073585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:38015 (local address 127.27.217.3:60955)
0809 16:18:58.073658 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:58.073671 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:58.073725 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:58.073851 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:58.073852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:58.073854 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:58.073927 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:58.073930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.074614 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.074615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:58.075377 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:58.075379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.076061 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.076062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:58.076145 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.076150 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:18:58.076203 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:18:58.076241 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 16:18:58.076313 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.073686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:60955 (local address 127.27.217.2:38015)
0809 16:18:58.073745 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:58.073747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:58.073757 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:18:58.073783 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:58.073784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:58.073792 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:58.073840 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:58.073998 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.074540 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.075456 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.075995 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.076051 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.076059 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:58.076221 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 16:18:58.076248 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 16:18:58.076639 22513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a4582ed5edc4298b277fb3768cf302a" candidate_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12bba0e744b345ddb1d7d4a381762bfe" is_pre_election: true
I20260809 16:18:58.076691 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.073673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:37391 (local address 127.27.217.3:51409)
0809 16:18:58.073858 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:58.073867 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:18:58.073916 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:18:58.074052 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:18:58.074053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:18:58.074055 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:18:58.074127 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:58.074128 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.074750 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.074750 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:58.075523 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:18:58.075525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.076318 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.076319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:18:58.076520 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.076525 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:18:58.076582 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 16:18:58.076620 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":101,"threads_started":1}
I20260809 16:18:58.076714 22392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.073767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:51409 (local address 127.27.217.1:37391)
0809 16:18:58.073814 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:58.073816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:58.073922 (+ 106us) server_negotiation.cc:407] Connection header received
0809 16:18:58.073956 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:58.073957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:58.073983 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:58.074041 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:18:58.074187 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.074677 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.075647 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.076238 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.076300 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.076387 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:58.076602 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 16:18:58.076655 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 16:18:58.076799 22513 raft_consensus.cc:2454] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e71027d6ca5476aa263ef503aa3cbdb in term 0.
I20260809 16:18:58.077016 22614 leader_election.cc:302] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12bba0e744b345ddb1d7d4a381762bfe, 4e71027d6ca5476aa263ef503aa3cbdb; no voters:
I20260809 16:18:58.077097 22307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a4582ed5edc4298b277fb3768cf302a" candidate_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555ebef457054052a68bf4cebd4affd4" is_pre_election: true
I20260809 16:18:58.077144 22804 raft_consensus.cc:2781] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:18:58.077201 22804 raft_consensus.cc:482] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:18:58.077222 22804 raft_consensus.cc:3037] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:58.077251 22307 raft_consensus.cc:2454] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e71027d6ca5476aa263ef503aa3cbdb in term 0.
I20260809 16:18:58.077965 22804 raft_consensus.cc:504] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.078076 22804 leader_election.cc:288] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [CANDIDATE]: Term 1 election: Requested vote from peers 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015), 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391)
I20260809 16:18:58.078236 22513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a4582ed5edc4298b277fb3768cf302a" candidate_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12bba0e744b345ddb1d7d4a381762bfe"
I20260809 16:18:58.078239 22307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a4582ed5edc4298b277fb3768cf302a" candidate_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "555ebef457054052a68bf4cebd4affd4"
I20260809 16:18:58.078308 22513 raft_consensus.cc:3037] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:58.078320 22307 raft_consensus.cc:3037] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:18:58.078979 22513 raft_consensus.cc:2454] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e71027d6ca5476aa263ef503aa3cbdb in term 1.
I20260809 16:18:58.079039 22307 raft_consensus.cc:2454] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e71027d6ca5476aa263ef503aa3cbdb in term 1.
I20260809 16:18:58.079185 22614 leader_election.cc:302] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e71027d6ca5476aa263ef503aa3cbdb, 555ebef457054052a68bf4cebd4affd4; no voters:
I20260809 16:18:58.079279 22804 raft_consensus.cc:2781] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:18:58.079424 22804 raft_consensus.cc:686] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 LEADER]: Becoming Leader. State: Replica: 4e71027d6ca5476aa263ef503aa3cbdb, State: Running, Role: LEADER
I20260809 16:18:58.079504 22804 consensus_queue.cc:237] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:18:58.080333 22095 catalog_manager.cc:5495] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3). New cstate: current_term: 1 leader_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } health_report { overall_health: UNKNOWN } } }
I20260809 16:18:58.098667 22797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.096564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42134 (local address 127.27.217.3:40243)
0809 16:18:58.096625 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:58.096627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:58.096636 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:18:58.096670 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:58.096671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:58.096691 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:58.096749 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:18:58.096860 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.097322 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.098013 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.098210 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.098263 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.098400 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:18:58.098450 (+ 50us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 16:18:58.098583 (+ 133us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42134: token expired
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 16:18:58.098733 22797 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42134: token expired
I20260809 16:18:58.104483 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.098983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44328 (local address 127.27.217.62:43629)
0809 16:18:58.099047 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:58.099049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:58.099057 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:18:58.099077 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:58.099078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:58.099087 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:58.099132 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:18:58.099623 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.100116 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.100760 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.100954 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.101005 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.102092 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:18:58.102093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:18:58.102093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:18:58.102100 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:18:58.103428 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:58.103792 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:58.103793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:58.103794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:58.103847 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:18:58.104017 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:18:58.104018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:18:58.104018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:18:58.104120 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:18:58.104207 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:58.104315 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 16:18:58.104394 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 16:18:58.107160 22797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.105235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42146 (local address 127.27.217.3:40243)
0809 16:18:58.105294 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 16:18:58.105296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:18:58.105304 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:18:58.105323 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:18:58.105324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:18:58.105334 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:18:58.105376 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:18:58.105481 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.105900 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.106523 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:18:58.106698 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:18:58.106749 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:18:58.106849 (+ 100us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:18:58.106941 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:18:58.106982 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 16:18:58.107073 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 16:18:58.107093 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 16:18:58.107477 22586 tablet.cc:2369] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:18:58.108999 22513 raft_consensus.cc:1261] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 1 FOLLOWER]: Refusing update from remote peer 4e71027d6ca5476aa263ef503aa3cbdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:58.109038 22307 raft_consensus.cc:1261] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Refusing update from remote peer 4e71027d6ca5476aa263ef503aa3cbdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:18:58.109371 22814 consensus_queue.cc:1035] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:58.109504 22804 consensus_queue.cc:1035] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:18:58.111935 22820 mvcc.cc:205] Tried to move back new op lower bound from 7316653416892026880 to 7316653416774426624. Current Snapshot: MvccSnapshot[applied={T|T < 7316653416892026880}]
I20260809 16:18:58.113747 22094 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:58.113827 22094 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:18:58.114482 22094 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Sending DeleteTablet for 3 replicas of tablet 4a4582ed5edc4298b277fb3768cf302a
I20260809 16:18:58.114789 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 22150
I20260809 16:18:58.114943 22485 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a4582ed5edc4298b277fb3768cf302a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:58 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:60216
I20260809 16:18:58.115269 22688 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a4582ed5edc4298b277fb3768cf302a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:18:58 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:42132
I20260809 16:18:58.123520 22830 tablet_replica.cc:330] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: stopping tablet replica
I20260809 16:18:58.123633 22830 raft_consensus.cc:2229] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:18:58.123744 22830 raft_consensus.cc:2258] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:58.125236 22830 ts_tablet_manager.cc:1905] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:58.126904 22830 ts_tablet_manager.cc:1918] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:58.126982 22830 log.cc:1196] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/4a4582ed5edc4298b277fb3768cf302a
I20260809 16:18:58.127255 22830 ts_tablet_manager.cc:1939] T 4a4582ed5edc4298b277fb3768cf302a P 12bba0e744b345ddb1d7d4a381762bfe: Deleting consensus metadata
I20260809 16:18:58.127691 22071 catalog_manager.cc:4841] TS 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015): tablet 4a4582ed5edc4298b277fb3768cf302a (table test-table [id=67af373e043a409cba8a5701b65a58b8]) successfully deleted
I20260809 16:18:58.127876 22832 tablet_replica.cc:330] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: stopping tablet replica
I20260809 16:18:58.127981 22832 raft_consensus.cc:2229] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:18:58.128078 22832 raft_consensus.cc:2258] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:18:58.135080 22832 ts_tablet_manager.cc:1905] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:18:58.138293 22832 ts_tablet_manager.cc:1918] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:18:58.138396 22832 log.cc:1196] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/4a4582ed5edc4298b277fb3768cf302a
I20260809 16:18:58.138772 22832 ts_tablet_manager.cc:1939] T 4a4582ed5edc4298b277fb3768cf302a P 4e71027d6ca5476aa263ef503aa3cbdb: Deleting consensus metadata
I20260809 16:18:58.140141 22072 catalog_manager.cc:4841] TS 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243): tablet 4a4582ed5edc4298b277fb3768cf302a (table test-table [id=67af373e043a409cba8a5701b65a58b8]) successfully deleted
W20260809 16:18:58.143710 22071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:37391 (error 108)
I20260809 16:18:58.144068 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 22386
I20260809 16:18:58.147583 22391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:18:58.144194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:37391 (local address 127.0.0.1:54104)
0809 16:18:58.147486 (+ 3292us) negotiation.cc:107] Waiting for socket to connect
0809 16:18:58.147543 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:37391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3265}
W20260809 16:18:58.149399 22071 catalog_manager.cc:4584] TS 555ebef457054052a68bf4cebd4affd4 (127.27.217.1:37391): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a4582ed5edc4298b277fb3768cf302a: Network error: Client connection negotiation failed: client connection to 127.27.217.1:37391: connect: Connection refused (error 111)
I20260809 16:18:58.161005 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 22588
I20260809 16:18:58.171517 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 22042
I20260809 16:19:18.179070 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:43629
--webserver_interface=127.27.217.62
--webserver_port=42001
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:43629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:18.260759 22835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:18.260955 22835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:18.260977 22835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:18.262086 22835 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 16:19:18.262126 22835 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 16:19:18.262137 22835 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 16:19:18.262151 22835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:18.262174 22835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:18.262198 22835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:18.262218 22835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:18.262240 22835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:18.263726 22835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:43629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:43629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=42001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:18.263962 22835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:18.264182 22835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:19:18.268877 22835 server_base.cc:1034] running on GCE node
W20260809 16:19:18.268926 22846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:18.268930 22844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:18.269105 22843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:18.269344 22835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:18.269603 22835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:18.270746 22835 hybrid_clock.cc:648] HybridClock initialized: now 1786292358270738 us; error 28 us; skew 500 ppm
Aug 09 16:19:18 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292358, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:18.273083 22835 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:19:18.273509 22835 webserver.cc:460] Webserver started at http://127.27.217.62:42001/ using document root <none> and password file <none>
I20260809 16:19:18.273721 22835 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:18.273768 22835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:18.274997 22835 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:19:18.275592 22853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:18.275753 22835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:18.275837 22835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "f493bdd602ce4336812116b8795ef1d4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "bd7ade57f09cc3178d38b73b7577b710"
server_key_iv: "3562da29eee40363bd29ac602d71e167"
server_key_version: "encryptionkey@0"
I20260809 16:19:18.276141 22835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:18.292678 22835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:18.294800 22835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:18.294947 22835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:18.298913 22835 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:43629
I20260809 16:19:18.298947 22928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:43629 every 8 connection(s)
I20260809 16:19:18.299304 22835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:18.300791 22929 sys_catalog.cc:263] Verifying existing consensus state
I20260809 16:19:18.301467 22929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Bootstrap starting.
I20260809 16:19:18.304610 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 22835
I20260809 16:19:18.304883 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:37391
--local_ip_for_outbound_sockets=127.27.217.1
--tserver_master_addrs=127.27.217.62:43629
--webserver_port=35689
--webserver_interface=127.27.217.1
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:19:18.310040 22929 log.cc:824] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:18.312250 22929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:19:18.312536 22929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Bootstrap complete.
I20260809 16:19:18.314608 22929 raft_consensus.cc:348] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:19:18.314828 22929 raft_consensus.cc:729] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f493bdd602ce4336812116b8795ef1d4, State: Initialized, Role: FOLLOWER
I20260809 16:19:18.314977 22929 consensus_queue.cc:260] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:19:18.315054 22929 raft_consensus.cc:388] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:18.315106 22929 raft_consensus.cc:482] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:18.315152 22929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 2 FOLLOWER]: Advancing to term 3
I20260809 16:19:18.316174 22929 raft_consensus.cc:504] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:19:18.316267 22929 leader_election.cc:302] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f493bdd602ce4336812116b8795ef1d4; no voters:
I20260809 16:19:18.316430 22929 leader_election.cc:288] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 16:19:18.316479 22934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 16:19:18.316606 22934 raft_consensus.cc:686] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [term 3 LEADER]: Becoming Leader. State: Replica: f493bdd602ce4336812116b8795ef1d4, State: Running, Role: LEADER
I20260809 16:19:18.316692 22934 consensus_queue.cc:237] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } }
I20260809 16:19:18.316699 22929 sys_catalog.cc:564] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:18.317015 22938 sys_catalog.cc:455] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f493bdd602ce4336812116b8795ef1d4. Latest consensus state: current_term: 3 leader_uuid: "f493bdd602ce4336812116b8795ef1d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } } }
I20260809 16:19:18.317010 22935 sys_catalog.cc:455] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f493bdd602ce4336812116b8795ef1d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493bdd602ce4336812116b8795ef1d4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 43629 } } }
I20260809 16:19:18.317106 22938 sys_catalog.cc:458] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:18.317113 22935 sys_catalog.cc:458] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:18.317291 22940 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:18.318081 22940 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:18.318188 22940 catalog_manager.cc:1259] Loaded cluster ID: 0dac69667ed94ef58b9625e8f85d6c25
I20260809 16:19:18.318222 22940 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:18.319404 22940 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:18.319588 22940 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Loaded TSK: 0
I20260809 16:19:18.319636 22940 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f493bdd602ce4336812116b8795ef1d4: Loaded TSK: 1
F20260809 16:19:18.319882 22940 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1b04dd29ad google::LogMessage::Fail() at ??:0
@ 0x7f1b04dd588a google::LogMessage::SendToLog() at ??:0
@ 0x7f1b04dd24de google::LogMessage::Flush() at ??:0
@ 0x7f1b04dd3a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1b0753f104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1b0753cd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1b0cd301cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1b0cd3048e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1b0cd30594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f1b0ccf6c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f1b0cd00ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1b06ca00d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1b06c95954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1b07af96db start_thread at ??:0
@ 0x7f1b038d061f clone at ??:0
W20260809 16:19:18.403326 22932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:18.403529 22932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:18.403553 22932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:18.404768 22932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:18.404810 22932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:18.404836 22932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:19:18.406260 22932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:37391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=35689
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:18.406471 22932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:18.406688 22932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:18.411454 22990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:18.411414 22985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:18.411620 22932 server_base.cc:1034] running on GCE node
W20260809 16:19:18.411432 22986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:18.411969 22932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:18.412269 22932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:18.413446 22932 hybrid_clock.cc:648] HybridClock initialized: now 1786292358413434 us; error 30 us; skew 500 ppm
Aug 09 16:19:18 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292358, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:18.416447 22932 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:19:18.416985 22932 webserver.cc:460] Webserver started at http://127.27.217.1:35689/ using document root <none> and password file <none>
I20260809 16:19:18.417227 22932 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:18.417295 22932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:18.418962 22932 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:19:18.419657 23000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:18.419826 22932 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:18.419903 22932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "555ebef457054052a68bf4cebd4affd4"
format_stamp: "Formatted at 2026-08-09 16:18:36 on dist-test-slave-nj21"
server_key: "c771d0263132735852aedb5e66504c89"
server_key_iv: "a473f5b16a198d7499da386c27c323c7"
server_key_version: "encryptionkey@0"
I20260809 16:19:18.420261 22932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:18.433300 22932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:18.435775 22932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:18.435901 22932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:18.436124 22932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:18.436565 23009 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 16:19:18.438457 22932 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 16:19:18.438499 22932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 16:19:18.438530 22932 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 16:19:18.439167 22932 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 16:19:18.439198 22932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 16:19:18.439291 23009 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Bootstrap starting.
I20260809 16:19:18.445917 22932 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:37391
I20260809 16:19:18.446065 23164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:37391 every 8 connection(s)
I20260809 16:19:18.446312 22932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:19:18.450423 23009 log.cc:824] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:18.450664 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 22932
I20260809 16:19:18.450992 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:38015
--local_ip_for_outbound_sockets=127.27.217.2
--tserver_master_addrs=127.27.217.62:43629
--webserver_port=44773
--webserver_interface=127.27.217.2
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:19:18.453127 23009 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 16:19:18.453440 23009 tablet_bootstrap.cc:492] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Bootstrap complete.
I20260809 16:19:18.454516 23009 ts_tablet_manager.cc:1397] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.013s
I20260809 16:19:18.455922 23009 raft_consensus.cc:348] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:19:18.456261 23009 raft_consensus.cc:729] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555ebef457054052a68bf4cebd4affd4, State: Initialized, Role: FOLLOWER
I20260809 16:19:18.456422 23009 consensus_queue.cc:260] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:19:18.456694 23009 ts_tablet_manager.cc:1428] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260809 16:19:18.514575 23169 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:19:18.446949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:51979)
0809 16:19:18.447116 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.447159 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:18.447572 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:18.514362 (+ 66790us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
W20260809 16:19:18.514853 23165 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:43629 (0 consecutive failures): Network error: Failed to ping master at 127.27.217.62:43629: Client connection negotiation failed: client connection to 127.27.217.62:43629: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 16:19:18.515206 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:18.515082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:57407)
0809 16:19:18.515136 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.515182 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 16:19:18.515533 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:18.515454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:56435)
0809 16:19:18.515490 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.515517 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 16:19:18.515709 23165 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 16:19:18.534308 23171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:18.534500 23171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:18.534523 23171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:18.535655 23171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:18.535727 23171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:18.535756 23171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:19:18.537153 23171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:38015
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=44773
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:18.537367 23171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:18.537587 23171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:18.542074 23180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:18.542137 23179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:18.542088 23183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:18.542320 23171 server_base.cc:1034] running on GCE node
I20260809 16:19:18.542500 23171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:18.542723 23171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:18.543857 23171 hybrid_clock.cc:648] HybridClock initialized: now 1786292358543842 us; error 27 us; skew 500 ppm
Aug 09 16:19:18 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292358, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:18.546150 23171 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:19:18.546541 23171 webserver.cc:460] Webserver started at http://127.27.217.2:44773/ using document root <none> and password file <none>
I20260809 16:19:18.546746 23171 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:18.546790 23171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:18.548034 23171 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:19:18.548547 23190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:18.548694 23171 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:18.548775 23171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "12bba0e744b345ddb1d7d4a381762bfe"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "6890c59cf9cf373ed1cc6187320e0947"
server_key_iv: "e5bf7b2749526af9705f53c4ac479d81"
server_key_version: "encryptionkey@0"
I20260809 16:19:18.549072 23171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:18.561930 23171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:18.563864 23171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:18.563995 23171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:18.564195 23171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:18.564476 23171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:18.564509 23171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:18.564536 23171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:18.564553 23171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:18.570037 23171 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:38015
I20260809 16:19:18.570077 23353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:38015 every 8 connection(s)
I20260809 16:19:18.570374 23171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:19:18.571308 23358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:18.570963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:41799)
0809 16:19:18.571101 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.571165 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
W20260809 16:19:18.571717 23354 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:43629 (0 consecutive failures): Network error: Failed to ping master at 127.27.217.62:43629: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
I20260809 16:19:18.571952 23358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:18.571870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:40127)
0809 16:19:18.571909 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.571934 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 16:19:18.572155 23358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:18.572096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:52011)
0809 16:19:18.572126 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.572143 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260809 16:19:18.572237 23354 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 16:19:18.577024 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 23171
I20260809 16:19:18.577272 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:40243
--local_ip_for_outbound_sockets=127.27.217.3
--tserver_master_addrs=127.27.217.62:43629
--webserver_port=41925
--webserver_interface=127.27.217.3
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:18.658126 23360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:18.658320 23360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:18.658341 23360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:18.659400 23360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:18.659435 23360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:18.659458 23360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:19:18.660876 23360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:40243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=41925
--tserver_master_addrs=127.27.217.62:43629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:18.661063 23360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:18.661232 23360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:18.665887 23369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:18.665936 23371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:18.666020 23368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:18.665983 23360 server_base.cc:1034] running on GCE node
I20260809 16:19:18.666292 23360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:18.666503 23360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:18.667662 23360 hybrid_clock.cc:648] HybridClock initialized: now 1786292358667651 us; error 34 us; skew 500 ppm
Aug 09 16:19:18 dist-test-slave-nj21 krb5kdc[21133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292358, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:18.670061 23360 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:19:18.670470 23360 webserver.cc:460] Webserver started at http://127.27.217.3:41925/ using document root <none> and password file <none>
I20260809 16:19:18.670660 23360 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:18.670697 23360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:18.671937 23360 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:19:18.672494 23378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:18.672646 23360 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:18.672726 23360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "4e71027d6ca5476aa263ef503aa3cbdb"
format_stamp: "Formatted at 2026-08-09 16:18:37 on dist-test-slave-nj21"
server_key: "e00ac8f01729fc461e63e675d17f28b4"
server_key_iv: "35005df380cd67880a7ed7c3367bf2ad"
server_key_version: "encryptionkey@0"
I20260809 16:19:18.673031 23360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:18.681066 23360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:18.682746 23360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:18.682859 23360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:18.683028 23360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:18.683261 23360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:18.683300 23360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:18.683319 23360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:18.683338 23360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:18.688951 23360 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:40243
I20260809 16:19:18.689023 23547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:40243 every 8 connection(s)
I20260809 16:19:18.689314 23360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:19:18.690382 23550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:18.690001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:56287)
0809 16:19:18.690167 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.690240 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
W20260809 16:19:18.690748 23548 heartbeater.cc:644] Failed to heartbeat to 127.27.217.62:43629 (0 consecutive failures): Network error: Failed to ping master at 127.27.217.62:43629: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
I20260809 16:19:18.690989 23550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:18.690910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:42211)
0809 16:19:18.690948 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.690973 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 16:19:18.691223 23550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:18.691154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:37217)
0809 16:19:18.691188 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:18.691209 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 16:19:18.691339 23548 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 16:19:18.692459 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 23360
I20260809 16:19:19.516273 23553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:19.516047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:35605)
0809 16:19:19.516166 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:19.516203 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260809 16:19:19.572733 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:19.572543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:58699)
0809 16:19:19.572646 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:19.572681 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":55,"threads_started":1}
I20260809 16:19:19.674310 23555 raft_consensus.cc:482] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:19.674435 23555 raft_consensus.cc:504] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:19:19.674820 23555 leader_election.cc:288] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243), 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015)
Aug 09 16:19:19 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292358, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.3@KRBTEST.COM
Aug 09 16:19:19 dist-test-slave-nj21 krb5kdc[21133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292358, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.2@KRBTEST.COM
I20260809 16:19:19.687604 23553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:19.674952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40243 (local address 127.27.217.1:59417)
0809 16:19:19.675004 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:19.675014 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:19.675068 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:19.676287 (+ 1219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:19.676290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:19.676825 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:19.677128 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:19.677136 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:19.678790 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:19.678791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:19.679918 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:19.679920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:19.680751 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:19.680752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:19.680878 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:19.681520 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:19.681525 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:19.683596 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:19.685751 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:19.685752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:19.685752 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:19.686136 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:19.686394 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:19.686395 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:19.686395 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:19.686558 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:19.687048 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:19.687056 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:19.687213 (+ 157us) client_negotiation.cc:769] Sending connection context
0809 16:19:19.687327 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 16:19:19.687497 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":69}
I20260809 16:19:19.687647 23557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:19.675075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:59417 (local address 127.27.217.3:40243)
0809 16:19:19.675267 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:19.675280 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:19.675304 (+ 24us) server_negotiation.cc:407] Connection header received
0809 16:19:19.675919 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:19.675922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:19.675998 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:19.676180 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:19.677267 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:19.678699 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:19.680016 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:19.680640 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:19.681158 (+ 518us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:19.683736 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:19.683740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:19.683741 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:19.683753 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:19.685657 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:19.686215 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:19.686218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:19.686218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:19.686328 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:19.686624 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:19.686625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:19.686625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:19.686946 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:19.687015 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:19.687408 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 16:19:19.687553 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":60,"threads_started":1}
I20260809 16:19:19.687685 23560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:19.675330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:38015 (local address 127.27.217.1:35419)
0809 16:19:19.675436 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:19.675446 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:19.675512 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:19.676367 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:19.676368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:19.676915 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:19.677128 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:19.677136 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:19.678677 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:19.678678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:19.679918 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:19.679920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:19.680835 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:19.680836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:19.680900 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:19.681499 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:19.681509 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:19.683652 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:19.685726 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:19.685735 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:19.685738 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:19.686136 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:19.686394 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:19.686395 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:19.686395 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:19.686558 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:19.687048 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:19.687056 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:19.687213 (+ 157us) client_negotiation.cc:769] Sending connection context
0809 16:19:19.687327 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 16:19:19.687564 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":167,"thread_start_us":54,"threads_started":1}
I20260809 16:19:19.688380 23558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:19.675117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:35419 (local address 127.27.217.2:38015)
0809 16:19:19.675363 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:19.675370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:19.675508 (+ 138us) server_negotiation.cc:407] Connection header received
0809 16:19:19.676094 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:19.676097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:19.676143 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:19.676268 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:19.677250 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:19.678572 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:19.679990 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:19.680632 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:19.680741 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:19.683777 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:19.683781 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:19.683781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:19.683790 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:19.685635 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:19.686215 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:19.686218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:19.686218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:19.686328 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:19.686624 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:19.686625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:19.686625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:19.686936 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:19.687015 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:19.687408 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 16:19:19.687547 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":122,"threads_started":1}
W20260809 16:19:19.688489 23003 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
W20260809 16:19:19.688985 23002 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
I20260809 16:19:19.689050 23002 leader_election.cc:302] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 555ebef457054052a68bf4cebd4affd4; no voters: 12bba0e744b345ddb1d7d4a381762bfe, 4e71027d6ca5476aa263ef503aa3cbdb
I20260809 16:19:19.689172 23555 raft_consensus.cc:2726] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:19:19.691816 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:19.691638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:49431)
0809 16:19:19.691749 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:19.691789 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":68,"threads_started":1}
I20260809 16:19:20.516824 23562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:20.516628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:49889)
0809 16:19:20.516741 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:20.516777 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":63,"threads_started":1}
I20260809 16:19:20.573282 23563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:20.573081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:60847)
0809 16:19:20.573205 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:20.573240 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":58,"threads_started":1}
I20260809 16:19:20.692348 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:20.692164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:52931)
0809 16:19:20.692273 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:20.692309 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":63,"threads_started":1}
I20260809 16:19:21.485332 23565 raft_consensus.cc:482] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:21.485440 23565 raft_consensus.cc:504] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:19:21.485596 23565 leader_election.cc:288] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243), 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015)
W20260809 16:19:21.486021 23003 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
W20260809 16:19:21.486115 23002 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
I20260809 16:19:21.486166 23002 leader_election.cc:302] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 555ebef457054052a68bf4cebd4affd4; no voters: 12bba0e744b345ddb1d7d4a381762bfe, 4e71027d6ca5476aa263ef503aa3cbdb
I20260809 16:19:21.486234 23565 raft_consensus.cc:2726] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:19:21.517429 23566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:21.517228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:42167)
0809 16:19:21.517341 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:21.517380 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":63,"threads_started":1}
I20260809 16:19:21.573892 23567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:21.573684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:47199)
0809 16:19:21.573823 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:21.573855 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260809 16:19:21.692958 23569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:21.692745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:41861)
0809 16:19:21.692879 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:21.692918 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
I20260809 16:19:22.517978 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:22.517771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:43513)
0809 16:19:22.517894 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:22.517929 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260809 16:19:22.574453 23571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:22.574260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:34501)
0809 16:19:22.574380 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:22.574414 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260809 16:19:22.693560 23572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:22.693346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:47719)
0809 16:19:22.693483 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:22.693516 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260809 16:19:23.518647 23573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:23.518446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:45045)
0809 16:19:23.518570 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:23.518600 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260809 16:19:23.575066 23576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:23.574850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:40463)
0809 16:19:23.574967 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:23.574998 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260809 16:19:23.694178 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:23.693984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:50431)
0809 16:19:23.694092 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:23.694132 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":58,"threads_started":1}
I20260809 16:19:23.828624 23579 raft_consensus.cc:482] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:23.828722 23579 raft_consensus.cc:504] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:19:23.828913 23579 leader_election.cc:288] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243), 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015)
W20260809 16:19:23.829295 23003 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
W20260809 16:19:23.829380 23002 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
I20260809 16:19:23.829402 23002 leader_election.cc:302] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 555ebef457054052a68bf4cebd4affd4; no voters: 12bba0e744b345ddb1d7d4a381762bfe, 4e71027d6ca5476aa263ef503aa3cbdb
I20260809 16:19:23.829483 23579 raft_consensus.cc:2726] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:19:24.519244 23580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:24.519039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:40807)
0809 16:19:24.519145 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:24.519179 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":60,"threads_started":1}
I20260809 16:19:24.575704 23581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:24.575475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:49903)
0809 16:19:24.575609 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:24.575643 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260809 16:19:24.694768 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:24.694547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:59117)
0809 16:19:24.694684 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:24.694720 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260809 16:19:25.519932 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:25.519724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:47659)
0809 16:19:25.519849 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:25.519886 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
I20260809 16:19:25.576294 23588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:25.576103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:42027)
0809 16:19:25.576221 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:25.576254 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260809 16:19:25.695423 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:25.695193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:38093)
0809 16:19:25.695340 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:25.695379 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":64,"threads_started":1}
I20260809 16:19:26.432339 23590 raft_consensus.cc:482] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:26.432435 23590 raft_consensus.cc:504] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:19:26.432603 23590 leader_election.cc:288] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243), 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015)
W20260809 16:19:26.433077 23003 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
W20260809 16:19:26.433197 23002 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
I20260809 16:19:26.433275 23002 leader_election.cc:302] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 555ebef457054052a68bf4cebd4affd4; no voters: 12bba0e744b345ddb1d7d4a381762bfe, 4e71027d6ca5476aa263ef503aa3cbdb
I20260809 16:19:26.433370 23590 raft_consensus.cc:2726] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:19:26.520570 23591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:26.520334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:54833)
0809 16:19:26.520484 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:26.520522 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260809 16:19:26.576924 23593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:26.576694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:58429)
0809 16:19:26.576838 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:26.576869 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260809 16:19:26.696031 23594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:26.695808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:52259)
0809 16:19:26.695941 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:26.695975 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260809 16:19:27.521217 23596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:27.520962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:37879)
0809 16:19:27.521098 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:27.521154 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
I20260809 16:19:27.577596 23598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:27.577359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:54517)
0809 16:19:27.577506 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:27.577549 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":65,"threads_started":1}
I20260809 16:19:27.696662 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:27.696456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:50855)
0809 16:19:27.696574 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:27.696611 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260809 16:19:28.522006 23601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:28.521767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:56325)
0809 16:19:28.521907 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:28.521948 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260809 16:19:28.578222 23602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:28.578037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:37941)
0809 16:19:28.578146 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:28.578182 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
I20260809 16:19:28.697219 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:28.697026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:58773)
0809 16:19:28.697135 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:28.697174 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":59,"threads_started":1}
I20260809 16:19:29.522753 23609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:29.522517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:57677)
0809 16:19:29.522656 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:29.522703 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260809 16:19:29.578891 23612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:29.578642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:54435)
0809 16:19:29.578792 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:29.578840 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260809 16:19:29.697968 23614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:29.697692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:55095)
0809 16:19:29.697860 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:29.697916 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":72,"threads_started":1}
I20260809 16:19:30.523409 23615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:30.523191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:47591)
0809 16:19:30.523323 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:30.523360 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260809 16:19:30.579588 23616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:30.579329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:46665)
0809 16:19:30.579489 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:30.579534 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":104,"threads_started":1}
I20260809 16:19:30.698698 23618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:30.698456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:57127)
0809 16:19:30.698610 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:30.698647 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":87,"threads_started":1}
I20260809 16:19:31.524020 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:31.523789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:41973)
0809 16:19:31.523924 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:31.523966 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260809 16:19:31.580231 23620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:31.580041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:59319)
0809 16:19:31.580152 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:31.580188 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
I20260809 16:19:31.699335 23624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:31.699130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:52051)
0809 16:19:31.699251 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:31.699287 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
I20260809 16:19:32.524593 23626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:32.524393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:58759)
0809 16:19:32.524513 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:32.524546 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260809 16:19:32.580848 23628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:32.580647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:52761)
0809 16:19:32.580771 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:32.580804 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260809 16:19:32.699965 23629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:32.699751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:46707)
0809 16:19:32.699883 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:32.699917 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
I20260809 16:19:33.411080 23630 raft_consensus.cc:482] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:33.411180 23630 raft_consensus.cc:504] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e71027d6ca5476aa263ef503aa3cbdb" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40243 } } peers { permanent_uuid: "12bba0e744b345ddb1d7d4a381762bfe" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 38015 } } peers { permanent_uuid: "555ebef457054052a68bf4cebd4affd4" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 37391 } }
I20260809 16:19:33.411348 23630 leader_election.cc:288] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243), 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015)
W20260809 16:19:33.411798 23003 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4e71027d6ca5476aa263ef503aa3cbdb (127.27.217.3:40243): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
W20260809 16:19:33.411883 23002 leader_election.cc:341] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12bba0e744b345ddb1d7d4a381762bfe (127.27.217.2:38015): Not found: Tablet not found: 4a4582ed5edc4298b277fb3768cf302a
I20260809 16:19:33.411926 23002 leader_election.cc:302] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 555ebef457054052a68bf4cebd4affd4; no voters: 12bba0e744b345ddb1d7d4a381762bfe, 4e71027d6ca5476aa263ef503aa3cbdb
I20260809 16:19:33.412006 23630 raft_consensus.cc:2726] T 4a4582ed5edc4298b277fb3768cf302a P 555ebef457054052a68bf4cebd4affd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 16:19:33.525290 23633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:33.525088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.1:34935)
0809 16:19:33.525206 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:33.525244 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260809 16:19:33.581475 23635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:33.581290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.2:45625)
0809 16:19:33.581402 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:33.581435 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
I20260809 16:19:33.700671 23638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:33.700460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:43629 (local address 127.27.217.3:43631)
0809 16:19:33.700591 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:33.700622 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.62:43629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260809 16:19:33.701839 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 22932
I20260809 16:19:33.714196 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 23171
I20260809 16:19:33.722266 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 23360
2026-08-09T16:19:33Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58360 ms)
[----------] 30 tests from SecurityITest (230596 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:33 dist-test-slave-nj21 krb5kdc[23641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:33 dist-test-slave-nj21 krb5kdc[23641](info): set up 2 sockets
Aug 09 16:19:33 dist-test-slave-nj21 krb5kdc[23641](info): commencing operation
krb5kdc: starting...
W20260809 16:19:34.879921 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:34 dist-test-slave-nj21 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:19:34.998675 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:42057
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:42057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:35.079191 23664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:35.079398 23664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:35.079427 23664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:35.080813 23664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:35.080857 23664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:35.080875 23664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:35.080892 23664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:35.080907 23664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:35.082415 23664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:42057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:42057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:35.082661 23664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:35.082865 23664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:35.087602 23671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.087612 23673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.087689 23676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:35.087618 23664 server_base.cc:1034] running on GCE node
I20260809 16:19:35.088014 23664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:35.088279 23664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:35.089421 23664 hybrid_clock.cc:648] HybridClock initialized: now 1786292375089403 us; error 33 us; skew 500 ppm
Aug 09 16:19:35 dist-test-slave-nj21 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292375, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:35.091799 23664 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:19:35.092219 23664 webserver.cc:460] Webserver started at http://127.27.217.62:41703/ using document root <none> and password file <none>
I20260809 16:19:35.092414 23664 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:35.092468 23664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:35.092594 23664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:35.093573 23664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "74274a37abaf49ebadff15ce332b7351"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "d1b4b58ce5ec14e3ea7d6f1b63bef904"
server_key_iv: "628593379ec5b8e2a3c62a06d7c42383"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.093895 23664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "74274a37abaf49ebadff15ce332b7351"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "d1b4b58ce5ec14e3ea7d6f1b63bef904"
server_key_iv: "628593379ec5b8e2a3c62a06d7c42383"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.095089 23664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:35.095738 23686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.095881 23664 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:35.095965 23664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "74274a37abaf49ebadff15ce332b7351"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "d1b4b58ce5ec14e3ea7d6f1b63bef904"
server_key_iv: "628593379ec5b8e2a3c62a06d7c42383"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.096031 23664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:35.107539 23664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:35.109526 23664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:35.109656 23664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:35.113420 23664 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:42057
I20260809 16:19:35.113461 23753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:42057 every 8 connection(s)
I20260809 16:19:35.113763 23664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:35.114544 23754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:35.116725 23754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351: Bootstrap starting.
I20260809 16:19:35.117244 23754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:35.117468 23754 log.cc:824] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:35.118084 23754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351: No bootstrap required, opened a new log
I20260809 16:19:35.119571 23754 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74274a37abaf49ebadff15ce332b7351" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42057 } }
I20260809 16:19:35.119735 23754 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:35.119769 23754 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74274a37abaf49ebadff15ce332b7351, State: Initialized, Role: FOLLOWER
I20260809 16:19:35.119882 23754 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74274a37abaf49ebadff15ce332b7351" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42057 } }
I20260809 16:19:35.119935 23754 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:35.119956 23754 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:35.119985 23754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:35.120436 23754 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74274a37abaf49ebadff15ce332b7351" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42057 } }
I20260809 16:19:35.120519 23754 leader_election.cc:302] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74274a37abaf49ebadff15ce332b7351; no voters:
I20260809 16:19:35.120636 23754 leader_election.cc:288] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:35.120684 23758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:35.120852 23754 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:35.120862 23758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [term 1 LEADER]: Becoming Leader. State: Replica: 74274a37abaf49ebadff15ce332b7351, State: Running, Role: LEADER
I20260809 16:19:35.121023 23758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74274a37abaf49ebadff15ce332b7351" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42057 } }
I20260809 16:19:35.121521 23762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74274a37abaf49ebadff15ce332b7351. Latest consensus state: current_term: 1 leader_uuid: "74274a37abaf49ebadff15ce332b7351" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74274a37abaf49ebadff15ce332b7351" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42057 } } }
I20260809 16:19:35.121868 23762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:35.121894 23759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74274a37abaf49ebadff15ce332b7351" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74274a37abaf49ebadff15ce332b7351" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 42057 } } }
I20260809 16:19:35.122044 23759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:35.122191 23776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:35.122699 23776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:35.123466 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 23664
I20260809 16:19:35.123579 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:35.123816 28516 external_mini_cluster.cc:1428] Setting key fb9e9fa6cfc63ec9c05745314994d32e
I20260809 16:19:35.124083 23776 catalog_manager.cc:1347] Generated new cluster ID: 93f767c7ba5446f1b5f25c242b88795b
I20260809 16:19:35.124135 23776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:19:35 dist-test-slave-nj21 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:35.140125 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.124474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40590 (local address 127.27.217.62:42057)
0809 16:19:35.124639 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.124646 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.131873 (+ 7227us) server_negotiation.cc:407] Connection header received
0809 16:19:35.131985 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.131990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.132033 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.132163 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:35.132801 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.133764 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.134497 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.134903 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.134996 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.137190 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:35.137193 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:35.137194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:35.137204 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:35.138683 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.139011 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.139014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.139014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.139096 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.139267 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.139268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.139269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.139492 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:35.139612 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.139755 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.139895 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
I20260809 16:19:35.154824 23776 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:35.155539 23776 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:35.160184 23776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351: Generated new TSK 0
I20260809 16:19:35.160343 23776 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:19:35.188112 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42057
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:35.272145 23792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:35.272352 23792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:35.272385 23792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:35.273556 23792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:35.273607 23792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:35.273644 23792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:19:35.275086 23792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:35.275331 23792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:35.275547 23792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:35.280351 23803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.280347 23802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.280349 23807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:35.280634 23792 server_base.cc:1034] running on GCE node
I20260809 16:19:35.280815 23792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:35.281036 23792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:35.282176 23792 hybrid_clock.cc:648] HybridClock initialized: now 1786292375282163 us; error 29 us; skew 500 ppm
Aug 09 16:19:35 dist-test-slave-nj21 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292375, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:35.284456 23792 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:19:35.284834 23792 webserver.cc:460] Webserver started at http://127.27.217.1:38503/ using document root <none> and password file <none>
I20260809 16:19:35.285027 23792 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:35.285068 23792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:35.285176 23792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:35.286139 23792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "f5193859b66c4b07adaa6d288d3f6920"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "ae8e8050f2960fe364b9e1a05236c437"
server_key_iv: "b201474ae461491d01b23724926ab304"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.286446 23792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "f5193859b66c4b07adaa6d288d3f6920"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "ae8e8050f2960fe364b9e1a05236c437"
server_key_iv: "b201474ae461491d01b23724926ab304"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.287618 23792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:19:35.288312 23817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.288440 23792 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.288515 23792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "f5193859b66c4b07adaa6d288d3f6920"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "ae8e8050f2960fe364b9e1a05236c437"
server_key_iv: "b201474ae461491d01b23724926ab304"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.288578 23792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:35.295599 23792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:35.297122 23792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:35.297238 23792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:35.297423 23792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:35.297684 23792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:35.297716 23792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.297736 23792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:35.297758 23792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.303218 23792 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:39511
I20260809 16:19:35.303280 23977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:39511 every 8 connection(s)
I20260809 16:19:35.303529 23792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:19:35.307127 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 23792
I20260809 16:19:35.307236 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:19:35.307458 28516 external_mini_cluster.cc:1428] Setting key 84a4aa7ad8bc25c94e93cb8a781cee1d
Aug 09 16:19:35 dist-test-slave-nj21 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292375, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:35.312584 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.304170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:52331 (local address 127.27.217.62:42057)
0809 16:19:35.304221 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.304223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.304394 (+ 171us) server_negotiation.cc:407] Connection header received
0809 16:19:35.304866 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.304868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.304884 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.304943 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:35.305823 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.306338 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.307474 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.307796 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.307857 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.310050 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:35.310051 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:35.310051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:35.310057 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:35.311295 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.311711 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.311712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.311712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.311776 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.311993 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.311994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.311994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.312121 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:35.312187 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.312399 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.312496 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:19:35.312624 23981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.304131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42057 (local address 127.27.217.1:52331)
0809 16:19:35.304289 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.304321 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:35.304774 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:35.304999 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:35.305002 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:35.305543 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:35.305728 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.305732 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.306421 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.306422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.307376 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.307379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.307886 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.307888 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.308003 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.308477 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:35.308486 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:35.309970 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:35.311381 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:35.311387 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:35.311389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:35.311620 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:35.311841 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:35.311841 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:35.311842 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:35.311942 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:35.312176 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:35.312178 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:35.312277 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 16:19:35.312348 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:19:35.312471 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260809 16:19:35.313124 23978 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42057
I20260809 16:19:35.313205 23978 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:35.313364 23978 heartbeater.cc:511] Master 127.27.217.62:42057 requested a full tablet report, sending...
I20260809 16:19:35.313911 23706 ts_manager.cc:194] Registered new tserver with Master: f5193859b66c4b07adaa6d288d3f6920 (127.27.217.1:39511)
I20260809 16:19:35.314832 23706 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:52331
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:19:35.332449 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42057
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:35.412473 23987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:35.412667 23987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:35.412688 23987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:35.413810 23987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:35.413851 23987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:35.413878 23987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:19:35.415300 23987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:35.415513 23987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:35.415747 23987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:35.420297 23999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.420310 23997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.420320 23996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:35.420517 23987 server_base.cc:1034] running on GCE node
I20260809 16:19:35.420687 23987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:35.420876 23987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:35.422019 23987 hybrid_clock.cc:648] HybridClock initialized: now 1786292375422005 us; error 37 us; skew 500 ppm
Aug 09 16:19:35 dist-test-slave-nj21 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292375, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:35.424330 23987 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:19:35.424711 23987 webserver.cc:460] Webserver started at http://127.27.217.2:44499/ using document root <none> and password file <none>
I20260809 16:19:35.424926 23987 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:35.424971 23987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:35.425096 23987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:35.426229 23987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "91c808cd6aa945abb7e0ed0a456f909e"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "778a8b35d6912ed7abe861b373e35abc"
server_key_iv: "fa36f612287f40d52d44d45228702a22"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.426568 23987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "91c808cd6aa945abb7e0ed0a456f909e"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "778a8b35d6912ed7abe861b373e35abc"
server_key_iv: "fa36f612287f40d52d44d45228702a22"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.427796 23987 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:19:35.428483 24011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.428650 23987 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.428732 23987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "91c808cd6aa945abb7e0ed0a456f909e"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "778a8b35d6912ed7abe861b373e35abc"
server_key_iv: "fa36f612287f40d52d44d45228702a22"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.428798 23987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:35.470434 23987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:35.472543 23987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:35.472680 23987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:35.472895 23987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:35.473186 23987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:35.473220 23987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.473250 23987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:35.473272 23987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.478592 23987 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:43527
I20260809 16:19:35.478657 24175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:43527 every 8 connection(s)
I20260809 16:19:35.478920 23987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:19:35 dist-test-slave-nj21 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292375, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:35.486780 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.479568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:57689 (local address 127.27.217.62:42057)
0809 16:19:35.479624 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.479627 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.479850 (+ 223us) server_negotiation.cc:407] Connection header received
0809 16:19:35.480309 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.480310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.480320 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.480365 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:35.481188 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.481671 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.482560 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.482736 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.482778 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.484646 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:35.484648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:35.484648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:35.484655 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:35.485669 (+ 1014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.486061 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.486062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.486062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.486108 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.486315 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.486315 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.486316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.486408 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:35.486452 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.486653 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.486714 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:19:35.486966 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.479536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42057 (local address 127.27.217.2:57689)
0809 16:19:35.479729 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.479771 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:35.480234 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:35.480427 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:35.480430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:35.480944 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:35.481125 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.481130 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.481732 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.481733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.482500 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.482502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.482785 (+ 283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.482786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.482889 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.483245 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:35.483252 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:35.484554 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:35.485762 (+ 1208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:35.485768 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:35.485770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:35.485995 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:35.486159 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:35.486160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:35.486161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:35.486267 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:35.486452 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:35.486455 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:35.486559 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 16:19:35.486639 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 16:19:35.486759 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260809 16:19:35.487315 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 23987
I20260809 16:19:35.487447 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:19:35.487494 24177 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42057
I20260809 16:19:35.487589 24177 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:35.487742 28516 external_mini_cluster.cc:1428] Setting key 5da0a11ffcbb04fd81c24b9959c97096
I20260809 16:19:35.487804 24177 heartbeater.cc:511] Master 127.27.217.62:42057 requested a full tablet report, sending...
I20260809 16:19:35.488200 23705 ts_manager.cc:194] Registered new tserver with Master: 91c808cd6aa945abb7e0ed0a456f909e (127.27.217.2:43527)
I20260809 16:19:35.488638 23705 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:57689
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:19:35.510375 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42057
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:44127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:35.589502 24182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:35.589682 24182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:35.589704 24182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:35.590786 24182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:35.590823 24182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:35.590853 24182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:19:35.592321 24182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:44127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:42057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:35.592499 24182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:35.592664 24182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:19:35.597198 24182 server_base.cc:1034] running on GCE node
W20260809 16:19:35.597163 24192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.597190 24190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.597167 24189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:35.597512 24182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:35.597743 24182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:35.598893 24182 hybrid_clock.cc:648] HybridClock initialized: now 1786292375598879 us; error 31 us; skew 500 ppm
Aug 09 16:19:35 dist-test-slave-nj21 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292375, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:35.601305 24182 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:19:35.601709 24182 webserver.cc:460] Webserver started at http://127.27.217.3:35721/ using document root <none> and password file <none>
I20260809 16:19:35.601899 24182 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:35.601948 24182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:35.602074 24182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:35.603037 24182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "8ed4316adaca4827bbcc899ba8bed539"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "bbcaf2e7739c54a40ec13bc491372bf6"
server_key_iv: "3327ae14ce929b80cdd4de0d90dd7f98"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.603353 24182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "8ed4316adaca4827bbcc899ba8bed539"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "bbcaf2e7739c54a40ec13bc491372bf6"
server_key_iv: "3327ae14ce929b80cdd4de0d90dd7f98"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.604602 24182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:19:35.605235 24206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.605381 24182 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:35.605461 24182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "8ed4316adaca4827bbcc899ba8bed539"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "bbcaf2e7739c54a40ec13bc491372bf6"
server_key_iv: "3327ae14ce929b80cdd4de0d90dd7f98"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.605520 24182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:35.624078 24182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:35.625762 24182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:35.625901 24182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:35.626111 24182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:35.626394 24182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:35.626427 24182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.626456 24182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:35.626480 24182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.632151 24182 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:45179
I20260809 16:19:35.632189 24363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:45179 every 8 connection(s)
I20260809 16:19:35.632522 24182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:19:35.634522 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 24182
I20260809 16:19:35.634626 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:19:35.634796 28516 external_mini_cluster.cc:1428] Setting key 91e0d8cd59b67e8e24eb11eebb1d01dc
Aug 09 16:19:35 dist-test-slave-nj21 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292375, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:35.641230 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.633135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:52645 (local address 127.27.217.62:42057)
0809 16:19:35.633210 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.633212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.633384 (+ 172us) server_negotiation.cc:407] Connection header received
0809 16:19:35.633907 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.633908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.633918 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.633968 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:35.634935 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.635649 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.636603 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.636786 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.636830 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.638845 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:35.638847 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:35.638847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:35.638855 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:35.640201 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.640570 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.640570 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.640570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.640615 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.640774 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.640775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.640775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.640864 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:35.640907 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.641108 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.641165 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 16:19:35.641384 24371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.633103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:42057 (local address 127.27.217.3:52645)
0809 16:19:35.633254 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.633289 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:35.633822 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:35.634020 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:35.634023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:35.634582 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:35.634809 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.634815 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.635756 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.635757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.636540 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.636542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.636839 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.636839 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.636929 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.637387 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:35.637394 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:35.638736 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:35.640272 (+ 1536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:35.640280 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:35.640282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:35.640512 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:35.640653 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:35.640653 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:35.640653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:35.640737 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:35.640906 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:35.640908 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:35.641015 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 16:19:35.641090 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 16:19:35.641204 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260809 16:19:35.641791 24367 heartbeater.cc:347] Connected to a master server at 127.27.217.62:42057
I20260809 16:19:35.641872 24367 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:35.642050 24367 heartbeater.cc:511] Master 127.27.217.62:42057 requested a full tablet report, sending...
I20260809 16:19:35.642397 23705 ts_manager.cc:194] Registered new tserver with Master: 8ed4316adaca4827bbcc899ba8bed539 (127.27.217.3:45179)
I20260809 16:19:35.642745 23705 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:52645
I20260809 16:19:35.646276 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:19:35.652684 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.647520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.27.217.62:42057)
0809 16:19:35.647562 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.647564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.647644 (+ 80us) server_negotiation.cc:407] Connection header received
0809 16:19:35.647734 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.647735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.647744 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.647786 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:35.648252 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.648719 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.649348 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.649528 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.649568 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.650493 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:35.650494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:35.650494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:35.650499 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:35.651661 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.651993 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.651994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.651995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.652044 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:35.652203 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:35.652204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:35.652204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:35.652335 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:35.652419 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.652525 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.652596 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 16:19:35.654096 23705 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:19:35.655593 23705 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:19:35.661617 24383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.657782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:43527 (local address 127.0.0.1:56854)
0809 16:19:35.657962 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.657971 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:35.658011 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:35.658229 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:35.658232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:35.658234 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:35.658298 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.658300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.659329 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.659330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.660481 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.660484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.661331 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.661331 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.661416 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.661430 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 16:19:35.661491 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 16:19:35.661544 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":46,"threads_started":1}
I20260809 16:19:35.661628 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.657899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56854 (local address 127.27.217.2:43527)
0809 16:19:35.658096 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.658100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.658108 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:35.658139 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.658141 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.658152 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.658211 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:35.658366 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.659244 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.660629 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.661258 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.661316 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.661374 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.661512 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.661554 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":89,"threads_started":1}
I20260809 16:19:35.662024 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.657583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:39511 (local address 127.0.0.1:59010)
0809 16:19:35.657881 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.657919 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:35.657989 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:35.658473 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:35.658474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:35.658476 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:35.658532 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.658534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.659837 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.659838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.660817 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.660819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.661784 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.661784 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.661848 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.661853 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:19:35.661909 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 16:19:35.661950 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":12,"thread_start_us":63,"threads_started":1}
I20260809 16:19:35.662055 24385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.657710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59010 (local address 127.27.217.1:39511)
0809 16:19:35.658332 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.658336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.658345 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:19:35.658383 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.658385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.658399 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.658468 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:35.658609 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.659721 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.660902 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.661620 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.661690 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.661746 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.661941 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.661979 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":82,"threads_started":1}
I20260809 16:19:35.662284 24384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.657701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53242 (local address 127.27.217.3:45179)
0809 16:19:35.658605 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.658609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.658619 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:19:35.658653 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.658654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.658669 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.658743 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:35.658858 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.659892 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.660998 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.661670 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.661725 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.661771 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.662176 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.662219 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":868,"thread_start_us":74,"threads_started":1}
I20260809 16:19:35.662113 24382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.657606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:45179 (local address 127.0.0.1:53242)
0809 16:19:35.657882 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.657919 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:35.657990 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:35.658751 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:35.658752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:35.658755 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:35.658795 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.658796 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.659976 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.659977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.660920 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.660922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.661799 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.661800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.661860 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.661863 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:35.661904 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 16:19:35.662055 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":56,"threads_started":1}
I20260809 16:19:35.662585 24087 tablet_service.cc:1467] Processing CreateTablet for tablet 75be0ff221134a9881215598c96d41d1 (DEFAULT_TABLE table=test-table [id=37be941f0f56468d8fdc5f64c423d158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:35.662955 24087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75be0ff221134a9881215598c96d41d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:35.663012 24279 tablet_service.cc:1467] Processing CreateTablet for tablet 75be0ff221134a9881215598c96d41d1 (DEFAULT_TABLE table=test-table [id=37be941f0f56468d8fdc5f64c423d158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:35.663007 23888 tablet_service.cc:1467] Processing CreateTablet for tablet 75be0ff221134a9881215598c96d41d1 (DEFAULT_TABLE table=test-table [id=37be941f0f56468d8fdc5f64c423d158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:35.663327 23888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75be0ff221134a9881215598c96d41d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:35.663327 24279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75be0ff221134a9881215598c96d41d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:35.665724 24389 tablet_bootstrap.cc:492] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Bootstrap starting.
I20260809 16:19:35.666263 24389 tablet_bootstrap.cc:654] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:35.666487 24390 tablet_bootstrap.cc:492] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: Bootstrap starting.
I20260809 16:19:35.666711 24391 tablet_bootstrap.cc:492] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920: Bootstrap starting.
I20260809 16:19:35.667162 24389 log.cc:824] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:35.667373 24391 tablet_bootstrap.cc:654] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:35.667989 24389 tablet_bootstrap.cc:492] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: No bootstrap required, opened a new log
I20260809 16:19:35.668001 24390 tablet_bootstrap.cc:654] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:35.668067 24389 ts_tablet_manager.cc:1397] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:19:35.668514 24390 log.cc:824] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:35.669147 24390 tablet_bootstrap.cc:492] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: No bootstrap required, opened a new log
I20260809 16:19:35.669209 24390 ts_tablet_manager.cc:1397] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 16:19:35.669260 24391 log.cc:824] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:35.670044 24391 tablet_bootstrap.cc:492] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920: No bootstrap required, opened a new log
I20260809 16:19:35.670110 24391 ts_tablet_manager.cc:1397] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 16:19:35.669979 24389 raft_consensus.cc:348] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.670358 24389 raft_consensus.cc:374] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:35.670454 24389 raft_consensus.cc:729] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91c808cd6aa945abb7e0ed0a456f909e, State: Initialized, Role: FOLLOWER
I20260809 16:19:35.670584 24389 consensus_queue.cc:260] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.670847 24389 ts_tablet_manager.cc:1428] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:19:35.670987 24177 heartbeater.cc:503] Master 127.27.217.62:42057 was elected leader, sending a full tablet report...
I20260809 16:19:35.670995 24390 raft_consensus.cc:348] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.671154 24390 raft_consensus.cc:374] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:35.671231 24390 raft_consensus.cc:729] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4316adaca4827bbcc899ba8bed539, State: Initialized, Role: FOLLOWER
I20260809 16:19:35.671360 24390 consensus_queue.cc:260] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.671614 24390 ts_tablet_manager.cc:1428] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 16:19:35.671634 24367 heartbeater.cc:503] Master 127.27.217.62:42057 was elected leader, sending a full tablet report...
I20260809 16:19:35.671972 24391 raft_consensus.cc:348] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.672137 24391 raft_consensus.cc:374] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:35.672184 24391 raft_consensus.cc:729] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5193859b66c4b07adaa6d288d3f6920, State: Initialized, Role: FOLLOWER
I20260809 16:19:35.672288 24391 consensus_queue.cc:260] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.672523 24391 ts_tablet_manager.cc:1428] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 16:19:35.672572 23978 heartbeater.cc:503] Master 127.27.217.62:42057 was elected leader, sending a full tablet report...
W20260809 16:19:35.729444 24178 tablet.cc:2369] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:19:35.738739 24398 raft_consensus.cc:482] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:35.738855 24398 raft_consensus.cc:504] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.739209 24398 leader_election.cc:288] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ed4316adaca4827bbcc899ba8bed539 (127.27.217.3:45179), 91c808cd6aa945abb7e0ed0a456f909e (127.27.217.2:43527)
I20260809 16:19:35.743022 24384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.739498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:43513 (local address 127.27.217.3:45179)
0809 16:19:35.739566 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.739568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.739578 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:19:35.739607 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.739608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.739617 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.739697 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:35.739846 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.740627 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.742069 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.742659 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.742730 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.742740 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.742922 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.742961 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 16:19:35.743027 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.739592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:36077 (local address 127.27.217.2:43527)
0809 16:19:35.739645 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.739646 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.739758 (+ 112us) server_negotiation.cc:407] Connection header received
0809 16:19:35.739802 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.739803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.739810 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.739861 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:35.739956 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.740633 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.742069 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.742659 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.742731 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.742740 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.742906 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.742953 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:19:35.743021 23981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.739379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:45179 (local address 127.27.217.1:43513)
0809 16:19:35.739428 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.739440 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:35.739483 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:35.739699 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:35.739701 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:35.739703 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:35.739782 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.739784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.740702 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.740702 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.741979 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.741982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.742732 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.742733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.742836 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.742843 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 16:19:35.742913 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 16:19:35.742947 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":81}
I20260809 16:19:35.743033 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.739508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:43527 (local address 127.27.217.1:36077)
0809 16:19:35.739693 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.739702 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:35.739757 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:35.739864 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:35.739864 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:35.739865 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:35.739911 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.739912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.740697 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.740698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.741980 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:35.741982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.742733 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.742734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:35.742836 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.742843 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 16:19:35.742894 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 16:19:35.742935 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":30,"thread_start_us":106,"threads_started":1}
I20260809 16:19:35.743412 24113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75be0ff221134a9881215598c96d41d1" candidate_uuid: "f5193859b66c4b07adaa6d288d3f6920" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91c808cd6aa945abb7e0ed0a456f909e" is_pre_election: true
I20260809 16:19:35.743434 24301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75be0ff221134a9881215598c96d41d1" candidate_uuid: "f5193859b66c4b07adaa6d288d3f6920" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4316adaca4827bbcc899ba8bed539" is_pre_election: true
I20260809 16:19:35.743566 24113 raft_consensus.cc:2454] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5193859b66c4b07adaa6d288d3f6920 in term 0.
I20260809 16:19:35.743568 24301 raft_consensus.cc:2454] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5193859b66c4b07adaa6d288d3f6920 in term 0.
I20260809 16:19:35.743796 23821 leader_election.cc:302] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ed4316adaca4827bbcc899ba8bed539, f5193859b66c4b07adaa6d288d3f6920; no voters:
I20260809 16:19:35.743923 24398 raft_consensus.cc:2781] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:19:35.743990 24398 raft_consensus.cc:482] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:19:35.744014 24398 raft_consensus.cc:3037] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:35.744714 24398 raft_consensus.cc:504] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.744830 24398 leader_election.cc:288] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [CANDIDATE]: Term 1 election: Requested vote from peers 8ed4316adaca4827bbcc899ba8bed539 (127.27.217.3:45179), 91c808cd6aa945abb7e0ed0a456f909e (127.27.217.2:43527)
I20260809 16:19:35.745004 24301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75be0ff221134a9881215598c96d41d1" candidate_uuid: "f5193859b66c4b07adaa6d288d3f6920" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4316adaca4827bbcc899ba8bed539"
I20260809 16:19:35.745072 24113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75be0ff221134a9881215598c96d41d1" candidate_uuid: "f5193859b66c4b07adaa6d288d3f6920" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91c808cd6aa945abb7e0ed0a456f909e"
I20260809 16:19:35.745101 24301 raft_consensus.cc:3037] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:35.745147 24113 raft_consensus.cc:3037] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:35.746014 24301 raft_consensus.cc:2454] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5193859b66c4b07adaa6d288d3f6920 in term 1.
I20260809 16:19:35.746013 24113 raft_consensus.cc:2454] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5193859b66c4b07adaa6d288d3f6920 in term 1.
I20260809 16:19:35.746192 23821 leader_election.cc:302] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ed4316adaca4827bbcc899ba8bed539, f5193859b66c4b07adaa6d288d3f6920; no voters:
I20260809 16:19:35.746284 24398 raft_consensus.cc:2781] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:35.746459 24398 raft_consensus.cc:686] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [term 1 LEADER]: Becoming Leader. State: Replica: f5193859b66c4b07adaa6d288d3f6920, State: Running, Role: LEADER
I20260809 16:19:35.746542 24398 consensus_queue.cc:237] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } }
I20260809 16:19:35.747306 23706 catalog_manager.cc:5495] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5193859b66c4b07adaa6d288d3f6920 (127.27.217.1). New cstate: current_term: 1 leader_uuid: "f5193859b66c4b07adaa6d288d3f6920" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5193859b66c4b07adaa6d288d3f6920" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 39511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 } health_report { overall_health: UNKNOWN } } }
I20260809 16:19:35.752503 24385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.750307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59020 (local address 127.27.217.1:39511)
0809 16:19:35.750350 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.750352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.750360 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:35.750430 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.750431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.750448 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.750498 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:19:35.750620 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.751070 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.751844 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.752019 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.752068 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.752217 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:19:35.752304 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:19:35.752367 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.752403 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.752421 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:19:35.753964 24113 raft_consensus.cc:1261] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 1 FOLLOWER]: Refusing update from remote peer f5193859b66c4b07adaa6d288d3f6920: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:35.753996 24301 raft_consensus.cc:1261] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 1 FOLLOWER]: Refusing update from remote peer f5193859b66c4b07adaa6d288d3f6920: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:35.754253 24398 consensus_queue.cc:1035] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91c808cd6aa945abb7e0ed0a456f909e" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 43527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:35.754364 24403 consensus_queue.cc:1035] T 75be0ff221134a9881215598c96d41d1 P f5193859b66c4b07adaa6d288d3f6920 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4316adaca4827bbcc899ba8bed539" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:35.756560 24412 mvcc.cc:205] Tried to move back new op lower bound from 7316653571086131200 to 7316653571058343936. Current Snapshot: MvccSnapshot[applied={T|T < 7316653571086131200}]
I20260809 16:19:35.759032 23706 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:35.759114 23706 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:35.759821 23706 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74274a37abaf49ebadff15ce332b7351: Sending DeleteTablet for 3 replicas of tablet 75be0ff221134a9881215598c96d41d1
I20260809 16:19:35.760130 23888 tablet_service.cc:1514] Processing DeleteTablet for tablet 75be0ff221134a9881215598c96d41d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:35 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:59010
I20260809 16:19:35.760154 24087 tablet_service.cc:1514] Processing DeleteTablet for tablet 75be0ff221134a9881215598c96d41d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:35 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:56854
I20260809 16:19:35.760171 24279 tablet_service.cc:1514] Processing DeleteTablet for tablet 75be0ff221134a9881215598c96d41d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:35 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:53242
I20260809 16:19:35.760344 24422 tablet_replica.cc:330] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: stopping tablet replica
I20260809 16:19:35.760445 24422 raft_consensus.cc:2229] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:35.760547 24422 raft_consensus.cc:2258] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:35.760737 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 23792
I20260809 16:19:35.765100 24422 ts_tablet_manager.cc:1905] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:35.766595 24422 ts_tablet_manager.cc:1918] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:35.766659 24422 log.cc:1196] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/75be0ff221134a9881215598c96d41d1
I20260809 16:19:35.766866 24422 ts_tablet_manager.cc:1939] T 75be0ff221134a9881215598c96d41d1 P 8ed4316adaca4827bbcc899ba8bed539: Deleting consensus metadata
I20260809 16:19:35.767225 23689 catalog_manager.cc:4841] TS 8ed4316adaca4827bbcc899ba8bed539 (127.27.217.3:45179): tablet 75be0ff221134a9881215598c96d41d1 (table test-table [id=37be941f0f56468d8fdc5f64c423d158]) successfully deleted
I20260809 16:19:35.768266 24423 tablet_replica.cc:330] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: stopping tablet replica
I20260809 16:19:35.768380 24423 raft_consensus.cc:2229] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:35.768478 24423 raft_consensus.cc:2258] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:35.769730 24423 ts_tablet_manager.cc:1905] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:35.771243 24423 ts_tablet_manager.cc:1918] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:35.771322 24423 log.cc:1196] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/75be0ff221134a9881215598c96d41d1
I20260809 16:19:35.771574 24423 ts_tablet_manager.cc:1939] T 75be0ff221134a9881215598c96d41d1 P 91c808cd6aa945abb7e0ed0a456f909e: Deleting consensus metadata
I20260809 16:19:35.772025 23689 catalog_manager.cc:4841] TS 91c808cd6aa945abb7e0ed0a456f909e (127.27.217.2:43527): tablet 75be0ff221134a9881215598c96d41d1 (table test-table [id=37be941f0f56468d8fdc5f64c423d158]) successfully deleted
W20260809 16:19:35.773569 23687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:39511 (error 108)
I20260809 16:19:35.774045 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.773923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:39511 (local address 127.0.0.1:59024)
0809 16:19:35.773980 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:35.774016 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:39511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 16:19:35.774117 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 23987
W20260809 16:19:35.774144 23687 catalog_manager.cc:4584] TS f5193859b66c4b07adaa6d288d3f6920 (127.27.217.1:39511): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 75be0ff221134a9881215598c96d41d1: Network error: Client connection negotiation failed: client connection to 127.27.217.1:39511: connect: Connection refused (error 111)
I20260809 16:19:35.795046 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 24182
I20260809 16:19:35.802691 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 23664
2026-08-09T16:19:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2076 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T16:19:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:35Z Disabled control of system clock
I20260809 16:19:35.831898 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:37977
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:37977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:35.910604 24434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:35.910808 24434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:35.910827 24434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:35.911979 24434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:35.912019 24434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:35.912029 24434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:35.912042 24434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:35.912067 24434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:35.913385 24434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:37977
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:37977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:35.913607 24434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:35.913868 24434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:35.918313 24448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.918323 24446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:35.918316 24444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:35.918597 24434 server_base.cc:1034] running on GCE node
I20260809 16:19:35.918824 24434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:35.919087 24434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:35.920220 24434 hybrid_clock.cc:648] HybridClock initialized: now 1786292375920204 us; error 37 us; skew 500 ppm
I20260809 16:19:35.921367 24434 webserver.cc:460] Webserver started at http://127.27.217.62:43649/ using document root <none> and password file <none>
I20260809 16:19:35.921584 24434 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:35.921631 24434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:35.921758 24434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:35.922770 24434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "b0ab2a4be4c04814afe91e0957471ef4"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "ce10a1e6fd6c27b2655baf93665184a6"
server_key_iv: "166e108afcb0be3762093384e3037534"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.923105 24434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "b0ab2a4be4c04814afe91e0957471ef4"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "ce10a1e6fd6c27b2655baf93665184a6"
server_key_iv: "166e108afcb0be3762093384e3037534"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.924396 24434 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:35.925062 24457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:35.925216 24434 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:35.925300 24434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "b0ab2a4be4c04814afe91e0957471ef4"
format_stamp: "Formatted at 2026-08-09 16:19:35 on dist-test-slave-nj21"
server_key: "ce10a1e6fd6c27b2655baf93665184a6"
server_key_iv: "166e108afcb0be3762093384e3037534"
server_key_version: "encryptionkey@0"
I20260809 16:19:35.925357 24434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:35.945215 24434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:35.945499 24434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:35.945621 24434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:35.949270 24434 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:37977
I20260809 16:19:35.949303 24537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:37977 every 8 connection(s)
I20260809 16:19:35.949615 24434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:35.950543 24539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:35.952798 24539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4: Bootstrap starting.
I20260809 16:19:35.953354 24539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:35.953624 24539 log.cc:824] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:35.954263 24539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4: No bootstrap required, opened a new log
I20260809 16:19:35.955829 24539 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ab2a4be4c04814afe91e0957471ef4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37977 } }
I20260809 16:19:35.955960 24539 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:35.955981 24539 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0ab2a4be4c04814afe91e0957471ef4, State: Initialized, Role: FOLLOWER
I20260809 16:19:35.956077 24539 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ab2a4be4c04814afe91e0957471ef4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37977 } }
I20260809 16:19:35.956121 24539 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:35.956105 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 24434
I20260809 16:19:35.956141 24539 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:35.956173 24539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:35.956213 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:35.956393 28516 external_mini_cluster.cc:1428] Setting key e43a8bccd7460d984f7185b94c7bae8c
I20260809 16:19:35.956710 24539 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ab2a4be4c04814afe91e0957471ef4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37977 } }
I20260809 16:19:35.956812 24539 leader_election.cc:302] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0ab2a4be4c04814afe91e0957471ef4; no voters:
I20260809 16:19:35.956985 24539 leader_election.cc:288] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:35.957051 24545 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:35.957178 24545 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [term 1 LEADER]: Becoming Leader. State: Replica: b0ab2a4be4c04814afe91e0957471ef4, State: Running, Role: LEADER
I20260809 16:19:35.957267 24539 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:35.957314 24545 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ab2a4be4c04814afe91e0957471ef4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37977 } }
I20260809 16:19:35.957758 24547 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0ab2a4be4c04814afe91e0957471ef4. Latest consensus state: current_term: 1 leader_uuid: "b0ab2a4be4c04814afe91e0957471ef4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ab2a4be4c04814afe91e0957471ef4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37977 } } }
I20260809 16:19:35.957844 24546 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0ab2a4be4c04814afe91e0957471ef4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ab2a4be4c04814afe91e0957471ef4" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 37977 } } }
I20260809 16:19:35.957916 24547 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:35.957944 24546 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:35.958127 24557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:35.958930 24557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:35.960417 24557 catalog_manager.cc:1347] Generated new cluster ID: 6a23ca718669446985b3fb55afa0c21e
I20260809 16:19:35.960469 24557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:35.962215 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:35.956844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43672 (local address 127.27.217.62:37977)
0809 16:19:35.957059 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:35.957068 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:35.957100 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:19:35.957220 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:35.957227 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:35.957297 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:35.957451 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:35.957693 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.959091 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.960150 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:35.960718 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:35.960826 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:35.961473 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:35.961476 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:35.961477 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:35.961675 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:35.961712 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:35.961725 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:35.961781 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:35.961855 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 16:19:35.962016 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":107,"threads_started":1}
I20260809 16:19:35.972342 24557 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:35.972800 24557 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:35.976478 24557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4: Generated new TSK 0
I20260809 16:19:35.976622 24557 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:35.980321 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:37977
--builtin_ntp_servers=127.27.217.20:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:36.059338 24572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:36.059527 24572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:36.059547 24572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:36.060693 24572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:36.060738 24572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:36.060770 24572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:19:36.062075 24572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:37977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:36.062282 24572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:36.062563 24572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:36.068152 24581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:36.068241 24584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:36.068166 24580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:36.068416 24572 server_base.cc:1034] running on GCE node
I20260809 16:19:36.068615 24572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:36.068889 24572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:36.070075 24572 hybrid_clock.cc:648] HybridClock initialized: now 1786292376070056 us; error 35 us; skew 500 ppm
I20260809 16:19:36.071547 24572 webserver.cc:460] Webserver started at http://127.27.217.1:46465/ using document root <none> and password file <none>
I20260809 16:19:36.071867 24572 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:36.071943 24572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:36.072077 24572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:36.073415 24572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "3567091e17534d7399a23e81d9195681"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "aa951088441b98b1907143952061618c"
server_key_iv: "cb03233cde191a022e699f399db58281"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.073787 24572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "3567091e17534d7399a23e81d9195681"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "aa951088441b98b1907143952061618c"
server_key_iv: "cb03233cde191a022e699f399db58281"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.075238 24572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:36.076058 24593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.076200 24572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.076295 24572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "3567091e17534d7399a23e81d9195681"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "aa951088441b98b1907143952061618c"
server_key_iv: "cb03233cde191a022e699f399db58281"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.076363 24572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:36.091043 24572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:36.091293 24572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:36.091392 24572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:36.091566 24572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:36.091926 24572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:36.091961 24572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.091988 24572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:36.092005 24572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.097400 24572 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:38155
I20260809 16:19:36.097461 24768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:38155 every 8 connection(s)
I20260809 16:19:36.097744 24572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:19:36.102267 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.098397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:48627 (local address 127.27.217.62:37977)
0809 16:19:36.098461 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.098463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.098671 (+ 208us) server_negotiation.cc:407] Connection header received
0809 16:19:36.099114 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.099115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.099126 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.099176 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:36.099822 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.100317 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.101198 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.101372 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.101414 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.102070 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:36.102071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:36.102071 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:36.102076 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:36.102089 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:36.102093 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:36.102131 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.102184 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.102208 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:19:36.102447 24773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.098376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:37977 (local address 127.27.217.1:48627)
0809 16:19:36.098550 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.098582 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:36.099040 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:36.099227 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:36.099230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:36.099238 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:36.099736 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.099740 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.100385 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.100386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.101136 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.101138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.101424 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.101424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.101523 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.101951 (+ 428us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:36.101951 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:36.101977 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:36.101999 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:36.102132 (+ 133us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:36.102134 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:36.102136 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:19:36.102178 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 16:19:36.102251 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260809 16:19:36.102902 24770 heartbeater.cc:347] Connected to a master server at 127.27.217.62:37977
I20260809 16:19:36.102982 24770 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:36.103130 24770 heartbeater.cc:511] Master 127.27.217.62:37977 requested a full tablet report, sending...
I20260809 16:19:36.103576 24478 ts_manager.cc:194] Registered new tserver with Master: 3567091e17534d7399a23e81d9195681 (127.27.217.1:38155)
I20260809 16:19:36.104184 24478 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.1:48627
I20260809 16:19:36.105443 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 24572
I20260809 16:19:36.105527 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:19:36.105710 28516 external_mini_cluster.cc:1428] Setting key 80bf3aa26e31b29bba5b69bf0a4b4ba6
I20260809 16:19:36.106474 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:37977
--builtin_ntp_servers=127.27.217.20:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:36.185748 24774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:36.185945 24774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:36.185966 24774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:36.187074 24774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:36.187112 24774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:36.187139 24774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:19:36.188484 24774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:37977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:36.188701 24774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:36.188973 24774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:36.193570 24784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:36.193571 24789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:36.193662 24783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:36.193797 24774 server_base.cc:1034] running on GCE node
I20260809 16:19:36.194032 24774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:36.194245 24774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:36.195374 24774 hybrid_clock.cc:648] HybridClock initialized: now 1786292376195370 us; error 32 us; skew 500 ppm
I20260809 16:19:36.196553 24774 webserver.cc:460] Webserver started at http://127.27.217.2:34967/ using document root <none> and password file <none>
I20260809 16:19:36.196771 24774 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:36.196815 24774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:36.196944 24774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:36.197922 24774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "83211697815a4cacbcae262876b55c46"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "0aed1049ed59d16fa04454676152ac3a"
server_key_iv: "d886fea037fac152f120e1f296e2fa72"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.198228 24774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "83211697815a4cacbcae262876b55c46"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "0aed1049ed59d16fa04454676152ac3a"
server_key_iv: "d886fea037fac152f120e1f296e2fa72"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.199473 24774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:19:36.200165 24799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.200320 24774 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.200407 24774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "83211697815a4cacbcae262876b55c46"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "0aed1049ed59d16fa04454676152ac3a"
server_key_iv: "d886fea037fac152f120e1f296e2fa72"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.200472 24774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:36.217265 24774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:36.217545 24774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:36.217674 24774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:36.217871 24774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:36.218169 24774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:36.218204 24774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.218231 24774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:36.218250 24774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.223656 24774 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:44183
I20260809 16:19:36.223731 24966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:44183 every 8 connection(s)
I20260809 16:19:36.224013 24774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:19:36.228909 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.224684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:36105 (local address 127.27.217.62:37977)
0809 16:19:36.224738 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.224740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.224956 (+ 216us) server_negotiation.cc:407] Connection header received
0809 16:19:36.225445 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.225446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.225459 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.225509 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:36.226172 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.226660 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.227604 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.227871 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.227925 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.228644 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:36.228645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:36.228645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:36.228650 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:36.228665 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:36.228669 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:36.228714 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.228797 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.228826 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 16:19:36.229107 24970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.224653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:37977 (local address 127.27.217.2:36105)
0809 16:19:36.224838 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.224869 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:36.225346 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:36.225587 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:36.225592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:36.225601 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:36.226085 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.226089 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.226746 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.226747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.227520 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.227523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.227955 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.227956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.228077 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.228521 (+ 444us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:36.228522 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:36.228548 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:36.228568 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:36.228719 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:36.228724 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:36.228727 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:36.228785 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 16:19:36.228918 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260809 16:19:36.229643 24967 heartbeater.cc:347] Connected to a master server at 127.27.217.62:37977
I20260809 16:19:36.229728 24967 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:36.229893 24967 heartbeater.cc:511] Master 127.27.217.62:37977 requested a full tablet report, sending...
I20260809 16:19:36.230284 24478 ts_manager.cc:194] Registered new tserver with Master: 83211697815a4cacbcae262876b55c46 (127.27.217.2:44183)
I20260809 16:19:36.230634 24478 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.2:36105
I20260809 16:19:36.231436 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 24774
I20260809 16:19:36.231524 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:19:36.231741 28516 external_mini_cluster.cc:1428] Setting key 20c73a63c773fb458a6e7e4d4b788610
I20260809 16:19:36.232506 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:37977
--builtin_ntp_servers=127.27.217.20:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:36.311594 24971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:36.311797 24971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:36.311825 24971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:36.312929 24971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:36.312969 24971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:36.313001 24971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:19:36.314293 24971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:37977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:36.314518 24971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:36.314774 24971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:36.319427 24980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:36.319478 24971 server_base.cc:1034] running on GCE node
W20260809 16:19:36.319458 24985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:36.319519 24982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:36.319855 24971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:36.320051 24971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:36.321180 24971 hybrid_clock.cc:648] HybridClock initialized: now 1786292376321171 us; error 29 us; skew 500 ppm
I20260809 16:19:36.322312 24971 webserver.cc:460] Webserver started at http://127.27.217.3:38929/ using document root <none> and password file <none>
I20260809 16:19:36.322538 24971 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:36.322582 24971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:36.322705 24971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:36.323732 24971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "c0d1703ce55f471199f18772fde1e66c"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "0c921c8db7927d53211671da9ed1a9dc"
server_key_iv: "d483d8b0f9620382aeaf65049fada78a"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.324059 24971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "c0d1703ce55f471199f18772fde1e66c"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "0c921c8db7927d53211671da9ed1a9dc"
server_key_iv: "d483d8b0f9620382aeaf65049fada78a"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.325243 24971 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:19:36.325939 24995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.326130 24971 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:36.326221 24971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "c0d1703ce55f471199f18772fde1e66c"
format_stamp: "Formatted at 2026-08-09 16:19:36 on dist-test-slave-nj21"
server_key: "0c921c8db7927d53211671da9ed1a9dc"
server_key_iv: "d483d8b0f9620382aeaf65049fada78a"
server_key_version: "encryptionkey@0"
I20260809 16:19:36.326279 24971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:36.356299 24971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:36.356582 24971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:36.356686 24971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:36.356884 24971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:36.357235 24971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:36.357273 24971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.357296 24971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:36.357318 24971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:36.362646 24971 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:41715
I20260809 16:19:36.362725 25158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:41715 every 8 connection(s)
I20260809 16:19:36.363018 24971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:19:36.367746 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.363719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:45417 (local address 127.27.217.62:37977)
0809 16:19:36.363780 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.363782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.364019 (+ 237us) server_negotiation.cc:407] Connection header received
0809 16:19:36.364476 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.364477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.364486 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.364546 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:36.365166 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.365649 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.366590 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.366773 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.366815 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.367499 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:36.367501 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:36.367501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:36.367506 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:36.367520 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:36.367524 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:36.367561 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.367620 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.367646 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:19:36.367900 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.363694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:37977 (local address 127.27.217.3:45417)
0809 16:19:36.363900 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.363941 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:36.364403 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:36.364598 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:36.364601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:36.364610 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:36.365105 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.365109 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.365735 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.365736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.366530 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.366532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.366830 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.366831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.366940 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.367378 (+ 438us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:36.367379 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:36.367405 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:36.367427 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:36.367568 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:36.367570 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:36.367572 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:19:36.367616 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:19:36.367712 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
I20260809 16:19:36.367906 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 24971
I20260809 16:19:36.368000 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:19:36.368197 28516 external_mini_cluster.cc:1428] Setting key 26b836a79db857790b3c5bf0b4fb83f6
I20260809 16:19:36.368453 25159 heartbeater.cc:347] Connected to a master server at 127.27.217.62:37977
I20260809 16:19:36.368551 25159 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:36.368748 25159 heartbeater.cc:511] Master 127.27.217.62:37977 requested a full tablet report, sending...
I20260809 16:19:36.369089 24478 ts_manager.cc:194] Registered new tserver with Master: c0d1703ce55f471199f18772fde1e66c (127.27.217.3:41715)
I20260809 16:19:36.369422 24478 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.3:45417
I20260809 16:19:36.379829 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:19:36.383718 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.381216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43688 (local address 127.27.217.62:37977)
0809 16:19:36.381284 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.381287 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.381361 (+ 74us) server_negotiation.cc:407] Connection header received
0809 16:19:36.381429 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.381430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.381444 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.381491 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:36.381635 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.382106 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.382788 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.382963 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.383003 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.383517 (+ 514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:36.383518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:36.383518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:36.383522 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:36.383534 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:36.383538 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:36.383573 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.383607 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.383629 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:19:36.385066 24478 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43688:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:19:36.386649 24478 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:19:36.392623 25170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.388593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:38155 (local address 127.0.0.1:58578)
0809 16:19:36.388721 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.388764 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:36.388832 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:36.389156 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:36.389160 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:36.389162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:36.389234 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.389236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.390547 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.390548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.391626 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.391629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.392319 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.392320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.392406 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.392420 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 16:19:36.392483 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 16:19:36.392534 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":8,"thread_start_us":78,"threads_started":1}
I20260809 16:19:36.392702 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.388948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54562 (local address 127.27.217.3:41715)
0809 16:19:36.389235 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.389240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.389248 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:36.389281 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.389283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.389298 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.389550 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:36.389608 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.390651 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.391622 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.392353 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.392471 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.392560 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.392588 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.392626 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":84,"threads_started":1}
I20260809 16:19:36.393045 25177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.389028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59646 (local address 127.27.217.2:44183)
0809 16:19:36.389210 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.389217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.389226 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:19:36.389262 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.389264 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.389279 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.389514 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:36.389580 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.390257 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.391730 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.392427 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.392487 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.392561 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.392918 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.392967 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":98,"threads_started":1}
I20260809 16:19:36.393203 25174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.388694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58578 (local address 127.27.217.1:38155)
0809 16:19:36.388915 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.388920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.388931 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:19:36.388970 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.388972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.388989 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.389070 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:36.389320 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.390467 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.391754 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.392239 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.392305 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.392400 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.393071 (+ 671us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.393122 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":89,"threads_started":1}
I20260809 16:19:36.392733 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.388597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:41715 (local address 127.0.0.1:54562)
0809 16:19:36.388763 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.388771 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:36.388832 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:36.389397 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:36.389398 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:36.389401 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:36.389477 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.389479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.390718 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.390719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.391551 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.391554 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.392477 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.392478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.392529 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.392532 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:36.392571 (+ 39us) client_negotiation.cc:240] Negotiation successful
0809 16:19:36.392602 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":97,"threads_started":1}
I20260809 16:19:36.392848 25175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.388814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:44183 (local address 127.0.0.1:59646)
0809 16:19:36.389039 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.389048 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:36.389094 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:36.389372 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:36.389373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:36.389386 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:36.389426 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.389428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.390356 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.390357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.391626 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.391629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.392656 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.392657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.392706 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.392709 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:36.392758 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 16:19:36.392794 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":4,"thread_start_us":63,"threads_started":1}
I20260809 16:19:36.394085 24671 tablet_service.cc:1467] Processing CreateTablet for tablet f31301f1d13c4ac6beae2f2c46508a92 (DEFAULT_TABLE table=test-table [id=098fbbd68aef46ceb27756aefe07ec1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:36.394088 24872 tablet_service.cc:1467] Processing CreateTablet for tablet f31301f1d13c4ac6beae2f2c46508a92 (DEFAULT_TABLE table=test-table [id=098fbbd68aef46ceb27756aefe07ec1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:36.394080 25068 tablet_service.cc:1467] Processing CreateTablet for tablet f31301f1d13c4ac6beae2f2c46508a92 (DEFAULT_TABLE table=test-table [id=098fbbd68aef46ceb27756aefe07ec1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:36.394425 24671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31301f1d13c4ac6beae2f2c46508a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:36.394425 24872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31301f1d13c4ac6beae2f2c46508a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:36.394425 25068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31301f1d13c4ac6beae2f2c46508a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:36.397609 25183 tablet_bootstrap.cc:492] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: Bootstrap starting.
I20260809 16:19:36.397712 25179 tablet_bootstrap.cc:492] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681: Bootstrap starting.
I20260809 16:19:36.397830 25186 tablet_bootstrap.cc:492] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: Bootstrap starting.
I20260809 16:19:36.398341 25179 tablet_bootstrap.cc:654] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:36.398371 25186 tablet_bootstrap.cc:654] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:36.398602 25179 log.cc:824] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:36.398609 25186 log.cc:824] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:36.399294 25186 tablet_bootstrap.cc:492] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: No bootstrap required, opened a new log
I20260809 16:19:36.399302 25183 tablet_bootstrap.cc:654] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:36.399307 25179 tablet_bootstrap.cc:492] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681: No bootstrap required, opened a new log
I20260809 16:19:36.399369 25179 ts_tablet_manager.cc:1397] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:36.399369 25186 ts_tablet_manager.cc:1397] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:36.399576 25183 log.cc:824] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:36.400204 25183 tablet_bootstrap.cc:492] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: No bootstrap required, opened a new log
I20260809 16:19:36.400269 25183 ts_tablet_manager.cc:1397] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 16:19:36.401880 25179 raft_consensus.cc:348] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.401957 25186 raft_consensus.cc:348] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.402072 25179 raft_consensus.cc:374] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:36.402084 25186 raft_consensus.cc:374] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:36.402113 25179 raft_consensus.cc:729] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3567091e17534d7399a23e81d9195681, State: Initialized, Role: FOLLOWER
I20260809 16:19:36.402114 25186 raft_consensus.cc:729] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d1703ce55f471199f18772fde1e66c, State: Initialized, Role: FOLLOWER
I20260809 16:19:36.402022 25183 raft_consensus.cc:348] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.402155 25183 raft_consensus.cc:374] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:36.402244 25183 raft_consensus.cc:729] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83211697815a4cacbcae262876b55c46, State: Initialized, Role: FOLLOWER
I20260809 16:19:36.402231 25186 consensus_queue.cc:260] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.402263 25179 consensus_queue.cc:260] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.402390 25183 consensus_queue.cc:260] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.402499 25186 ts_tablet_manager.cc:1428] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:19:36.402503 25179 ts_tablet_manager.cc:1428] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:19:36.402572 24770 heartbeater.cc:503] Master 127.27.217.62:37977 was elected leader, sending a full tablet report...
I20260809 16:19:36.402690 25183 ts_tablet_manager.cc:1428] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 16:19:36.402729 25159 heartbeater.cc:503] Master 127.27.217.62:37977 was elected leader, sending a full tablet report...
I20260809 16:19:36.402954 24967 heartbeater.cc:503] Master 127.27.217.62:37977 was elected leader, sending a full tablet report...
I20260809 16:19:36.440783 25198 raft_consensus.cc:482] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:36.440904 25198 raft_consensus.cc:504] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.441207 25198 leader_election.cc:288] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3567091e17534d7399a23e81d9195681 (127.27.217.1:38155), c0d1703ce55f471199f18772fde1e66c (127.27.217.3:41715)
I20260809 16:19:36.444965 25174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.441429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:59287 (local address 127.27.217.1:38155)
0809 16:19:36.441488 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.441490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.441623 (+ 133us) server_negotiation.cc:407] Connection header received
0809 16:19:36.441650 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.441651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.441663 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.441710 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:36.441840 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.442605 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.444064 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.444606 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.444679 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.444687 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.444852 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.444891 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:19:36.444965 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.441505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:60127 (local address 127.27.217.3:41715)
0809 16:19:36.441550 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.441552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.441562 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:19:36.441588 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.441588 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.441596 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.441657 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:36.441841 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.442596 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.444060 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.444606 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.444680 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.444687 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.444852 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.444897 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:19:36.445011 24970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.441384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:41715 (local address 127.27.217.2:60127)
0809 16:19:36.441440 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.441452 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:36.441499 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:36.441670 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:36.441671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:36.441672 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:36.441775 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.441777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.442690 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.442691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.443982 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.443986 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.444682 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.444683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.444786 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.444791 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:19:36.444843 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 16:19:36.444893 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":62}
I20260809 16:19:36.445017 25199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.441371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:38155 (local address 127.27.217.2:59287)
0809 16:19:36.441556 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.441564 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:36.441607 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:36.441729 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:36.441729 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:36.441731 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:36.441781 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.441782 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.442690 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.442691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.443982 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:36.443986 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.444682 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.444683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:36.444786 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.444792 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 16:19:36.444843 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 16:19:36.444893 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":38,"thread_start_us":106,"threads_started":1}
I20260809 16:19:36.445358 24702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31301f1d13c4ac6beae2f2c46508a92" candidate_uuid: "83211697815a4cacbcae262876b55c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3567091e17534d7399a23e81d9195681" is_pre_election: true
I20260809 16:19:36.445427 25092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31301f1d13c4ac6beae2f2c46508a92" candidate_uuid: "83211697815a4cacbcae262876b55c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d1703ce55f471199f18772fde1e66c" is_pre_election: true
I20260809 16:19:36.445510 24702 raft_consensus.cc:2454] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83211697815a4cacbcae262876b55c46 in term 0.
I20260809 16:19:36.445568 25092 raft_consensus.cc:2454] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83211697815a4cacbcae262876b55c46 in term 0.
I20260809 16:19:36.445729 24800 leader_election.cc:302] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3567091e17534d7399a23e81d9195681, 83211697815a4cacbcae262876b55c46; no voters:
I20260809 16:19:36.445873 25198 raft_consensus.cc:2781] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:19:36.445935 25198 raft_consensus.cc:482] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:19:36.445956 25198 raft_consensus.cc:3037] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:36.446626 25198 raft_consensus.cc:504] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.446745 25198 leader_election.cc:288] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [CANDIDATE]: Term 1 election: Requested vote from peers 3567091e17534d7399a23e81d9195681 (127.27.217.1:38155), c0d1703ce55f471199f18772fde1e66c (127.27.217.3:41715)
I20260809 16:19:36.446892 25092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31301f1d13c4ac6beae2f2c46508a92" candidate_uuid: "83211697815a4cacbcae262876b55c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d1703ce55f471199f18772fde1e66c"
I20260809 16:19:36.446946 24702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31301f1d13c4ac6beae2f2c46508a92" candidate_uuid: "83211697815a4cacbcae262876b55c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3567091e17534d7399a23e81d9195681"
I20260809 16:19:36.446960 25092 raft_consensus.cc:3037] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:36.447029 24702 raft_consensus.cc:3037] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:36.447705 25092 raft_consensus.cc:2454] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83211697815a4cacbcae262876b55c46 in term 1.
I20260809 16:19:36.447805 24702 raft_consensus.cc:2454] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83211697815a4cacbcae262876b55c46 in term 1.
I20260809 16:19:36.447886 24804 leader_election.cc:302] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83211697815a4cacbcae262876b55c46, c0d1703ce55f471199f18772fde1e66c; no voters:
I20260809 16:19:36.447969 25198 raft_consensus.cc:2781] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:36.448104 25198 raft_consensus.cc:686] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 1 LEADER]: Becoming Leader. State: Replica: 83211697815a4cacbcae262876b55c46, State: Running, Role: LEADER
I20260809 16:19:36.448195 25198 consensus_queue.cc:237] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } }
I20260809 16:19:36.448956 24477 catalog_manager.cc:5495] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83211697815a4cacbcae262876b55c46 (127.27.217.2). New cstate: current_term: 1 leader_uuid: "83211697815a4cacbcae262876b55c46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83211697815a4cacbcae262876b55c46" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44183 } health_report { overall_health: HEALTHY } } }
I20260809 16:19:36.467636 25177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.465516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59648 (local address 127.27.217.2:44183)
0809 16:19:36.465567 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:36.465569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:36.465575 (+ 6us) server_negotiation.cc:407] Connection header received
0809 16:19:36.465605 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:36.465605 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:36.465623 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:36.465681 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:19:36.465795 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.466239 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.466938 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:36.467141 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:36.467195 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:36.467327 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:19:36.467424 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:19:36.467497 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:36.467534 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 16:19:36.467553 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:19:36.469173 24702 raft_consensus.cc:1261] T f31301f1d13c4ac6beae2f2c46508a92 P 3567091e17534d7399a23e81d9195681 [term 1 FOLLOWER]: Refusing update from remote peer 83211697815a4cacbcae262876b55c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:36.469174 25092 raft_consensus.cc:1261] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 1 FOLLOWER]: Refusing update from remote peer 83211697815a4cacbcae262876b55c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:36.469462 25198 consensus_queue.cc:1035] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3567091e17534d7399a23e81d9195681" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:36.469594 25201 consensus_queue.cc:1035] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d1703ce55f471199f18772fde1e66c" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 41715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:36.472121 25209 mvcc.cc:205] Tried to move back new op lower bound from 7316653574015586304 to 7316653573932433408. Current Snapshot: MvccSnapshot[applied={T|T < 7316653574015586304}]
I20260809 16:19:36.472261 25206 mvcc.cc:205] Tried to move back new op lower bound from 7316653574015586304 to 7316653573932433408. Current Snapshot: MvccSnapshot[applied={T|T < 7316653574015586304}]
I20260809 16:19:36.473945 24478 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:36.474035 24478 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:36.474730 24478 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0ab2a4be4c04814afe91e0957471ef4: Sending DeleteTablet for 3 replicas of tablet f31301f1d13c4ac6beae2f2c46508a92
I20260809 16:19:36.475044 25068 tablet_service.cc:1514] Processing DeleteTablet for tablet f31301f1d13c4ac6beae2f2c46508a92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:36 UTC) from {username='slave'} at 127.0.0.1:54562
I20260809 16:19:36.475050 24872 tablet_service.cc:1514] Processing DeleteTablet for tablet f31301f1d13c4ac6beae2f2c46508a92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:36 UTC) from {username='slave'} at 127.0.0.1:59646
I20260809 16:19:36.475109 24671 tablet_service.cc:1514] Processing DeleteTablet for tablet f31301f1d13c4ac6beae2f2c46508a92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:36 UTC) from {username='slave'} at 127.0.0.1:58578
I20260809 16:19:36.475257 25220 tablet_replica.cc:330] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: stopping tablet replica
I20260809 16:19:36.475266 25221 tablet_replica.cc:330] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: stopping tablet replica
I20260809 16:19:36.475346 25220 raft_consensus.cc:2229] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:36.475346 25221 raft_consensus.cc:2229] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:19:36.475446 25220 raft_consensus.cc:2258] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:36.475461 25221 raft_consensus.cc:2258] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:36.475464 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 24572
I20260809 16:19:36.481886 25221 ts_tablet_manager.cc:1905] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:36.483510 25221 ts_tablet_manager.cc:1918] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:36.483583 25221 log.cc:1196] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/f31301f1d13c4ac6beae2f2c46508a92
I20260809 16:19:36.483865 25221 ts_tablet_manager.cc:1939] T f31301f1d13c4ac6beae2f2c46508a92 P 83211697815a4cacbcae262876b55c46: Deleting consensus metadata
I20260809 16:19:36.484054 25220 ts_tablet_manager.cc:1905] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:36.484324 24458 catalog_manager.cc:4841] TS 83211697815a4cacbcae262876b55c46 (127.27.217.2:44183): tablet f31301f1d13c4ac6beae2f2c46508a92 (table test-table [id=098fbbd68aef46ceb27756aefe07ec1a]) successfully deleted
W20260809 16:19:36.485738 24458 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:38155 (error 108)
I20260809 16:19:36.485788 25220 ts_tablet_manager.cc:1918] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:36.485852 25220 log.cc:1196] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/f31301f1d13c4ac6beae2f2c46508a92
I20260809 16:19:36.486024 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 24774
I20260809 16:19:36.486310 25175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:36.486198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:38155 (local address 127.0.0.1:58582)
0809 16:19:36.486246 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:36.486279 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:38155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 16:19:36.486399 24458 catalog_manager.cc:4584] TS 3567091e17534d7399a23e81d9195681 (127.27.217.1:38155): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f31301f1d13c4ac6beae2f2c46508a92: Network error: Client connection negotiation failed: client connection to 127.27.217.1:38155: connect: Connection refused (error 111)
I20260809 16:19:36.487883 25220 ts_tablet_manager.cc:1939] T f31301f1d13c4ac6beae2f2c46508a92 P c0d1703ce55f471199f18772fde1e66c: Deleting consensus metadata
I20260809 16:19:36.488304 24462 catalog_manager.cc:4841] TS c0d1703ce55f471199f18772fde1e66c (127.27.217.3:41715): tablet f31301f1d13c4ac6beae2f2c46508a92 (table test-table [id=098fbbd68aef46ceb27756aefe07ec1a]) successfully deleted
I20260809 16:19:36.492188 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 24971
I20260809 16:19:36.510082 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 24434
2026-08-09T16:19:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (706 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:36 dist-test-slave-nj21 krb5kdc[25232](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:36 dist-test-slave-nj21 krb5kdc[25232](info): set up 2 sockets
Aug 09 16:19:36 dist-test-slave-nj21 krb5kdc[25232](info): commencing operation
krb5kdc: starting...
W20260809 16:19:37.653005 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:37 dist-test-slave-nj21 krb5kdc[25232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292377, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:19:37.768313 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41305
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41305
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:37.847224 25248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:37.847409 25248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:37.847429 25248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:37.848565 25248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:37.848606 25248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:37.848618 25248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:37.848631 25248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:37.848654 25248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:37.850113 25248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:37.850337 25248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:37.850543 25248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:37.854946 25256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:37.855068 25248 server_base.cc:1034] running on GCE node
W20260809 16:19:37.854964 25254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:37.854965 25258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:37.855399 25248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:37.855690 25248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:37.856825 25248 hybrid_clock.cc:648] HybridClock initialized: now 1786292377856803 us; error 42 us; skew 500 ppm
Aug 09 16:19:37 dist-test-slave-nj21 krb5kdc[25232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292377, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:37.859076 25248 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:19:37.859481 25248 webserver.cc:460] Webserver started at http://127.27.217.62:44699/ using document root <none> and password file <none>
I20260809 16:19:37.859710 25248 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:37.859760 25248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:37.859889 25248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:37.860859 25248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "a778147088a24f28b2401d795ebfde73"
format_stamp: "Formatted at 2026-08-09 16:19:37 on dist-test-slave-nj21"
server_key: "78ee094c5d9fd562f658e0d94e3b8ad9"
server_key_iv: "ed046178acac3626a58a9ea8535057f4"
server_key_version: "encryptionkey@0"
I20260809 16:19:37.861182 25248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "a778147088a24f28b2401d795ebfde73"
format_stamp: "Formatted at 2026-08-09 16:19:37 on dist-test-slave-nj21"
server_key: "78ee094c5d9fd562f658e0d94e3b8ad9"
server_key_iv: "ed046178acac3626a58a9ea8535057f4"
server_key_version: "encryptionkey@0"
I20260809 16:19:37.862357 25248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:19:37.863016 25267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:37.863159 25248 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:37.863245 25248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "a778147088a24f28b2401d795ebfde73"
format_stamp: "Formatted at 2026-08-09 16:19:37 on dist-test-slave-nj21"
server_key: "78ee094c5d9fd562f658e0d94e3b8ad9"
server_key_iv: "ed046178acac3626a58a9ea8535057f4"
server_key_version: "encryptionkey@0"
I20260809 16:19:37.863302 25248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:37.897606 25248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:37.899840 25248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:37.899950 25248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:37.903637 25248 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:41305
I20260809 16:19:37.903712 25334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:41305 every 8 connection(s)
I20260809 16:19:37.904022 25248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:37.904872 25335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:37.907094 25335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73: Bootstrap starting.
I20260809 16:19:37.907656 25335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:37.907956 25335 log.cc:824] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:37.908604 25335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73: No bootstrap required, opened a new log
I20260809 16:19:37.910135 25335 raft_consensus.cc:348] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a778147088a24f28b2401d795ebfde73" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41305 } }
I20260809 16:19:37.910279 25335 raft_consensus.cc:374] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:37.910301 25335 raft_consensus.cc:729] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a778147088a24f28b2401d795ebfde73, State: Initialized, Role: FOLLOWER
I20260809 16:19:37.910439 25335 consensus_queue.cc:260] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a778147088a24f28b2401d795ebfde73" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41305 } }
I20260809 16:19:37.910502 25335 raft_consensus.cc:388] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:37.910522 25335 raft_consensus.cc:482] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:37.910552 25335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:37.911031 25335 raft_consensus.cc:504] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a778147088a24f28b2401d795ebfde73" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41305 } }
I20260809 16:19:37.911121 25335 leader_election.cc:302] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a778147088a24f28b2401d795ebfde73; no voters:
I20260809 16:19:37.911278 25335 leader_election.cc:288] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:37.911310 25338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:37.911437 25338 raft_consensus.cc:686] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [term 1 LEADER]: Becoming Leader. State: Replica: a778147088a24f28b2401d795ebfde73, State: Running, Role: LEADER
I20260809 16:19:37.911521 25335 sys_catalog.cc:564] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:37.911554 25338 consensus_queue.cc:237] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a778147088a24f28b2401d795ebfde73" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41305 } }
I20260809 16:19:37.911978 25343 sys_catalog.cc:455] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a778147088a24f28b2401d795ebfde73. Latest consensus state: current_term: 1 leader_uuid: "a778147088a24f28b2401d795ebfde73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a778147088a24f28b2401d795ebfde73" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41305 } } }
I20260809 16:19:37.912066 25343 sys_catalog.cc:458] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:37.912091 25342 sys_catalog.cc:455] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a778147088a24f28b2401d795ebfde73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a778147088a24f28b2401d795ebfde73" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41305 } } }
I20260809 16:19:37.912163 25342 sys_catalog.cc:458] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:37.912293 25354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:37.912771 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 25248
I20260809 16:19:37.912796 25354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:37.912882 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:37.913084 28516 external_mini_cluster.cc:1428] Setting key 52c4236677b5ff48dc72caf36411a0f3
I20260809 16:19:37.914309 25354 catalog_manager.cc:1347] Generated new cluster ID: 67d3836304dc41e895c4add20610b281
I20260809 16:19:37.914361 25354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:19:37 dist-test-slave-nj21 krb5kdc[25232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292377, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:37.930989 25354 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:37.931535 25354 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:37.932993 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:37.913699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42884 (local address 127.27.217.62:41305)
0809 16:19:37.913925 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:37.913933 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:37.913964 (+ 31us) server_negotiation.cc:407] Connection header received
0809 16:19:37.914073 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:37.914079 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:37.914132 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:37.923760 (+ 9628us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:37.923837 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:37.924680 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:37.925754 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:37.926344 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:37.926440 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:37.929119 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:37.929123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:37.929124 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:37.929136 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:37.930904 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:37.931291 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:37.931294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:37.931294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:37.931405 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:37.931639 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:37.931640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:37.931641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:37.931966 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:37.932135 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:37.932203 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 16:19:37.932351 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":80,"threads_started":1}
I20260809 16:19:37.934849 25354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73: Generated new TSK 0
I20260809 16:19:37.934993 25354 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:19:37.959832 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41305
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:38.039130 25373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:38.039317 25373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:38.039338 25373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:38.040436 25373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:38.040474 25373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:38.040499 25373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:19:38.041862 25373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:38.042030 25373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:38.042202 25373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:38.046820 25380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:38.046902 25385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:38.046819 25381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:38.046968 25373 server_base.cc:1034] running on GCE node
I20260809 16:19:38.047201 25373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:38.047432 25373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:38.048564 25373 hybrid_clock.cc:648] HybridClock initialized: now 1786292378048548 us; error 28 us; skew 500 ppm
Aug 09 16:19:38 dist-test-slave-nj21 krb5kdc[25232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292378, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:38.050909 25373 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:19:38.051297 25373 webserver.cc:460] Webserver started at http://127.27.217.1:36831/ using document root <none> and password file <none>
I20260809 16:19:38.051496 25373 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:38.051541 25373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:38.051697 25373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:38.052640 25373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "87eb187eeda747778f45d94b45e261a1"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "c43fc68945e4e3823831cd8bf2d1dd2c"
server_key_iv: "219675dec5ad25213c2ffe4644a79f84"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.052959 25373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "87eb187eeda747778f45d94b45e261a1"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "c43fc68945e4e3823831cd8bf2d1dd2c"
server_key_iv: "219675dec5ad25213c2ffe4644a79f84"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.054150 25373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:19:38.054771 25397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.054926 25373 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:38.055006 25373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "87eb187eeda747778f45d94b45e261a1"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "c43fc68945e4e3823831cd8bf2d1dd2c"
server_key_iv: "219675dec5ad25213c2ffe4644a79f84"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.055063 25373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:38.063931 25373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:38.065442 25373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:38.065564 25373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:38.065778 25373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:38.066087 25373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:38.066121 25373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.066148 25373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:38.066171 25373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.071735 25373 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:36957
I20260809 16:19:38.071767 25547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:36957 every 8 connection(s)
I20260809 16:19:38.072045 25373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:19:38.073901 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 25373
I20260809 16:19:38.073997 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:19:38.074179 28516 external_mini_cluster.cc:1428] Setting key ee15eca36fcec9a8121be7a1d8fbf706
Aug 09 16:19:38 dist-test-slave-nj21 krb5kdc[25232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292378, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:38.081306 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.072676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:49725 (local address 127.27.217.62:41305)
0809 16:19:38.072716 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.072719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.072897 (+ 178us) server_negotiation.cc:407] Connection header received
0809 16:19:38.073377 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.073378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.073395 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.073444 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:38.074443 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.075107 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.076105 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.076387 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.076469 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.078671 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:38.078672 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:38.078673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:38.078679 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:38.080011 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:38.080456 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:38.080456 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:38.080457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:38.080502 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:38.080739 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:38.080740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:38.080740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:38.080830 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:38.080873 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.081167 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.081237 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 16:19:38.081602 25552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.072643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41305 (local address 127.27.217.1:49725)
0809 16:19:38.072787 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.072821 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.073283 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.073515 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.073519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.074098 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:38.074332 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.074338 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.075201 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.075202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.076030 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.076033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.076475 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.076476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.076611 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.077044 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:38.077054 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:38.078582 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:38.080084 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:38.080091 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:38.080093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:38.080388 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:38.080555 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:38.080555 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:38.080556 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:38.080685 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:38.080881 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:38.080886 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:38.081044 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.081157 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.081325 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":72,"threads_started":1}
I20260809 16:19:38.082156 25548 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41305
I20260809 16:19:38.082255 25548 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:38.082440 25548 heartbeater.cc:511] Master 127.27.217.62:41305 requested a full tablet report, sending...
I20260809 16:19:38.082967 25292 ts_manager.cc:194] Registered new tserver with Master: 87eb187eeda747778f45d94b45e261a1 (127.27.217.1:36957)
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
I20260809 16:19:38.083581 25292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:49725
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:19:38.099134 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41305
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:38.180373 25555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:38.180576 25555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:38.180608 25555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:38.181707 25555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:38.181746 25555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:38.181779 25555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:19:38.183166 25555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:38.183390 25555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:38.183604 25555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:38.188287 25564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:38.188287 25566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:38.188298 25562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:38.188482 25555 server_base.cc:1034] running on GCE node
I20260809 16:19:38.188730 25555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:38.188962 25555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:38.190131 25555 hybrid_clock.cc:648] HybridClock initialized: now 1786292378190114 us; error 27 us; skew 500 ppm
Aug 09 16:19:38 dist-test-slave-nj21 krb5kdc[25232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292378, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:38.192575 25555 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:19:38.192994 25555 webserver.cc:460] Webserver started at http://127.27.217.2:46645/ using document root <none> and password file <none>
I20260809 16:19:38.193167 25555 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:38.193205 25555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:38.193305 25555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:38.194281 25555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "2bac879afadc4c5ca24d1f928e514067"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "7e1652cfe79a7f9b11a03147b96c8619"
server_key_iv: "a675a2deeafbce872e84d64bf4e1146d"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.194573 25555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "2bac879afadc4c5ca24d1f928e514067"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "7e1652cfe79a7f9b11a03147b96c8619"
server_key_iv: "a675a2deeafbce872e84d64bf4e1146d"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.195868 25555 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:19:38.196591 25579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.196750 25555 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:38.196830 25555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "2bac879afadc4c5ca24d1f928e514067"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "7e1652cfe79a7f9b11a03147b96c8619"
server_key_iv: "a675a2deeafbce872e84d64bf4e1146d"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.196895 25555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:38.208621 25555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:38.210249 25555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:38.210354 25555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:38.210527 25555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:38.210798 25555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:38.210829 25555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.210865 25555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:38.210889 25555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.216759 25555 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:44505
I20260809 16:19:38.216799 25740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:44505 every 8 connection(s)
I20260809 16:19:38.217087 25555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:19:38 dist-test-slave-nj21 krb5kdc[25232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292378, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:38.224401 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 25555
I20260809 16:19:38.224521 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:19:38.224713 28516 external_mini_cluster.cc:1428] Setting key 543c78e5cdb055b13b8a1b6d9346ac33
I20260809 16:19:38.225001 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.217710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:52801 (local address 127.27.217.62:41305)
0809 16:19:38.217783 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.217785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.217948 (+ 163us) server_negotiation.cc:407] Connection header received
0809 16:19:38.218383 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.218384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.218399 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.218449 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:38.219284 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.219826 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.220716 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.220894 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.220945 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.222728 (+ 1783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:38.222730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:38.222730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:38.222736 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:38.223813 (+ 1077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:38.224138 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:38.224139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:38.224139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:38.224183 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:38.224394 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:38.224395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:38.224395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:38.224499 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:38.224561 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.224815 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.224898 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 16:19:38.225139 25743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.217677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41305 (local address 127.27.217.2:52801)
0809 16:19:38.217823 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.217867 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.218312 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.218499 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.218502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.219039 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:38.219220 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.219225 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.219900 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.219901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.220656 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.220658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.220945 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.220945 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.221038 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.221397 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:38.221404 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:38.222650 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:38.223878 (+ 1228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:38.223884 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:38.223885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:38.224082 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:38.224220 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:38.224220 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:38.224220 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:38.224340 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:38.224564 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:38.224571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:38.224697 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.224786 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.224936 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":85,"threads_started":1}
I20260809 16:19:38.225519 25741 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41305
I20260809 16:19:38.225600 25741 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:38.225762 25741 heartbeater.cc:511] Master 127.27.217.62:41305 requested a full tablet report, sending...
I20260809 16:19:38.226109 25292 ts_manager.cc:194] Registered new tserver with Master: 2bac879afadc4c5ca24d1f928e514067 (127.27.217.2:44505)
I20260809 16:19:38.226547 25292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:52801
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:19:38.249801 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41305
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:38085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:38.329789 25748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:38.329977 25748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:38.329998 25748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:38.331144 25748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:38.331185 25748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:38.331209 25748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:19:38.332667 25748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:41305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:38.332880 25748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:38.333081 25748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:38.337819 25758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:38.337809 25761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:38.338066 25748 server_base.cc:1034] running on GCE node
W20260809 16:19:38.337806 25757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:38.338625 25748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:38.338860 25748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:38.339990 25748 hybrid_clock.cc:648] HybridClock initialized: now 1786292378339976 us; error 32 us; skew 500 ppm
Aug 09 16:19:38 dist-test-slave-nj21 krb5kdc[25232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292378, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:38.342345 25748 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:19:38.342721 25748 webserver.cc:460] Webserver started at http://127.27.217.3:40853/ using document root <none> and password file <none>
I20260809 16:19:38.342911 25748 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:38.342952 25748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:38.343066 25748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:38.344099 25748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "117f5b9149f54119b34237107570ff92"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "7c17b6898060e84d058ddb460be2d2d3"
server_key_iv: "37149cfd5feb5e857839cf922c3a8385"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.344408 25748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "117f5b9149f54119b34237107570ff92"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "7c17b6898060e84d058ddb460be2d2d3"
server_key_iv: "37149cfd5feb5e857839cf922c3a8385"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.345567 25748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:19:38.346191 25771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.346333 25748 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:38.346411 25748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "117f5b9149f54119b34237107570ff92"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "7c17b6898060e84d058ddb460be2d2d3"
server_key_iv: "37149cfd5feb5e857839cf922c3a8385"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.346473 25748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:38.370183 25748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:38.371898 25748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:38.372025 25748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:38.372243 25748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:38.372527 25748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:38.372560 25748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.372581 25748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:38.372604 25748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.378034 25748 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:45343
I20260809 16:19:38.378093 25941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:45343 every 8 connection(s)
I20260809 16:19:38.378362 25748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:19:38 dist-test-slave-nj21 krb5kdc[25232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292378, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:38.384327 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 25748
I20260809 16:19:38.384429 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:19:38.384649 28516 external_mini_cluster.cc:1428] Setting key 563d9ca3aa4ac2672fa7f16c21c8f8f9
I20260809 16:19:38.386868 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.379011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:52743 (local address 127.27.217.62:41305)
0809 16:19:38.379070 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.379072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.379247 (+ 175us) server_negotiation.cc:407] Connection header received
0809 16:19:38.379777 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.379779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.379792 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.379836 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:38.380725 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.381225 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.382172 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.382361 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.382415 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.384393 (+ 1978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:38.384394 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:38.384395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:38.384402 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:38.385853 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:38.386182 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:38.386183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:38.386183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:38.386230 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:38.386409 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:38.386410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:38.386410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:38.386512 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:38.386557 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.386748 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.386804 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 16:19:38.387039 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.378977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41305 (local address 127.27.217.3:52743)
0809 16:19:38.379138 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.379173 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.379663 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.379902 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.379906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.380454 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:38.380634 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.380639 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.381305 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.381306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.382091 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.382093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.382429 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.382430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.382548 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.382943 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:38.382951 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:38.384306 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:38.385919 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:38.385925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:38.385926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:38.386127 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:38.386273 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:38.386273 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:38.386273 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:38.386368 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:38.386553 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:38.386556 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:38.386658 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.386729 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.386840 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":84,"threads_started":1}
I20260809 16:19:38.387472 25945 heartbeater.cc:347] Connected to a master server at 127.27.217.62:41305
I20260809 16:19:38.387557 25945 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:38.387733 25945 heartbeater.cc:511] Master 127.27.217.62:41305 requested a full tablet report, sending...
I20260809 16:19:38.388059 25292 ts_manager.cc:194] Registered new tserver with Master: 117f5b9149f54119b34237107570ff92 (127.27.217.3:45343)
I20260809 16:19:38.388410 25292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:52743
I20260809 16:19:38.396239 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:19:38.403306 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.397540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42890 (local address 127.27.217.62:41305)
0809 16:19:38.397595 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.397597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.397701 (+ 104us) server_negotiation.cc:407] Connection header received
0809 16:19:38.397769 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.397770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.397779 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.397821 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:38.398372 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.398847 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.399578 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.399808 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.399864 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.401074 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:38.401075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:38.401075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:38.401082 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:38.402162 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:38.402532 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:38.402533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:38.402534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:38.402589 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:38.402783 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:38.402784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:38.402785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:38.402920 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:38.403021 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.403146 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.403211 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:19:38.404659 25292 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:19:38.406167 25292 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:19:38.412949 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.408083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:45343 (local address 127.0.0.1:54260)
0809 16:19:38.408204 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.408245 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.408310 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.408957 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.408958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.408960 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:38.409004 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.409006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.410337 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.410337 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.411710 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.411712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.412652 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.412653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.412732 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.412746 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.412816 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.412870 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":58,"thread_start_us":73,"threads_started":1}
I20260809 16:19:38.413187 25958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.408168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54260 (local address 127.27.217.3:45343)
0809 16:19:38.408735 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.408739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.408747 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:38.408785 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.408787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.408801 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.409128 (+ 327us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:38.409199 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.410239 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.411779 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.412589 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.412640 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.412679 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.413079 (+ 400us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.413118 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":79,"threads_started":1}
I20260809 16:19:38.413797 25956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.408286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:44505 (local address 127.0.0.1:50162)
0809 16:19:38.408543 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.408552 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.408591 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.408923 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.408924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.408925 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:38.408964 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.408966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.411262 (+ 2296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.411263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.412320 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.412324 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.413463 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.413464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.413636 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.413640 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.413692 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.413730 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":70,"threads_started":1}
I20260809 16:19:38.413801 25962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.408524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50162 (local address 127.27.217.2:44505)
0809 16:19:38.408696 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.408700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.408708 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:38.408744 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.408746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.408763 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.408837 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:38.410318 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.411175 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.412397 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.413395 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.413465 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.413519 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.413707 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.413742 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260809 16:19:38.413923 25844 tablet_service.cc:1467] Processing CreateTablet for tablet d50740ecbfb546fcba125a381255e8da (DEFAULT_TABLE table=test-table [id=a95ba1009321475f8c3dd65316606ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:38.414288 25844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50740ecbfb546fcba125a381255e8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:38.414405 25631 tablet_service.cc:1467] Processing CreateTablet for tablet d50740ecbfb546fcba125a381255e8da (DEFAULT_TABLE table=test-table [id=a95ba1009321475f8c3dd65316606ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:38.414665 25631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50740ecbfb546fcba125a381255e8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:38.416898 25963 tablet_bootstrap.cc:492] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: Bootstrap starting.
I20260809 16:19:38.417153 25964 tablet_bootstrap.cc:492] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Bootstrap starting.
I20260809 16:19:38.417536 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.408089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:36957 (local address 127.0.0.1:45520)
0809 16:19:38.408404 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.408414 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.408464 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.408879 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.408886 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.408890 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:38.408964 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.408966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.410282 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.410283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.411708 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.411712 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.417282 (+ 5570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.417283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.417363 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.417368 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.417424 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.417466 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":34,"thread_start_us":52,"threads_started":1}
I20260809 16:19:38.417613 25960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.408269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45520 (local address 127.27.217.1:36957)
0809 16:19:38.408594 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.408599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.408609 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:19:38.408648 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.408650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.408665 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.408745 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:38.409029 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.410186 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.412707 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.417116 (+ 4409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.417183 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.417244 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.417471 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.417526 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":79,"threads_started":1}
I20260809 16:19:38.417693 25963 tablet_bootstrap.cc:654] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:38.417800 25964 tablet_bootstrap.cc:654] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:38.418257 25963 log.cc:824] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:38.418306 25964 log.cc:824] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:38.418494 25465 tablet_service.cc:1467] Processing CreateTablet for tablet d50740ecbfb546fcba125a381255e8da (DEFAULT_TABLE table=test-table [id=a95ba1009321475f8c3dd65316606ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:38.418815 25465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d50740ecbfb546fcba125a381255e8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:38.418988 25964 tablet_bootstrap.cc:492] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: No bootstrap required, opened a new log
I20260809 16:19:38.419003 25963 tablet_bootstrap.cc:492] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: No bootstrap required, opened a new log
I20260809 16:19:38.419034 25964 ts_tablet_manager.cc:1397] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:38.419060 25963 ts_tablet_manager.cc:1397] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:19:38.420382 25964 raft_consensus.cc:348] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.420506 25964 raft_consensus.cc:374] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:38.420524 25964 raft_consensus.cc:729] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bac879afadc4c5ca24d1f928e514067, State: Initialized, Role: FOLLOWER
I20260809 16:19:38.420612 25964 consensus_queue.cc:260] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.420862 25964 ts_tablet_manager.cc:1428] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:19:38.420949 25741 heartbeater.cc:503] Master 127.27.217.62:41305 was elected leader, sending a full tablet report...
I20260809 16:19:38.420924 25963 raft_consensus.cc:348] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.421105 25963 raft_consensus.cc:374] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:38.421152 25963 raft_consensus.cc:729] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 117f5b9149f54119b34237107570ff92, State: Initialized, Role: FOLLOWER
I20260809 16:19:38.421249 25963 consensus_queue.cc:260] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.421486 25963 ts_tablet_manager.cc:1428] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 16:19:38.421604 25945 heartbeater.cc:503] Master 127.27.217.62:41305 was elected leader, sending a full tablet report...
I20260809 16:19:38.421983 25969 tablet_bootstrap.cc:492] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1: Bootstrap starting.
I20260809 16:19:38.422540 25969 tablet_bootstrap.cc:654] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:38.422992 25969 log.cc:824] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:38.423579 25969 tablet_bootstrap.cc:492] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1: No bootstrap required, opened a new log
I20260809 16:19:38.423629 25969 ts_tablet_manager.cc:1397] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:38.424916 25969 raft_consensus.cc:348] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.425052 25969 raft_consensus.cc:374] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:38.425083 25969 raft_consensus.cc:729] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87eb187eeda747778f45d94b45e261a1, State: Initialized, Role: FOLLOWER
I20260809 16:19:38.425181 25969 consensus_queue.cc:260] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.425395 25969 ts_tablet_manager.cc:1428] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:19:38.425424 25548 heartbeater.cc:503] Master 127.27.217.62:41305 was elected leader, sending a full tablet report...
W20260809 16:19:38.467584 25742 tablet.cc:2369] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:19:38.569793 25973 raft_consensus.cc:482] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:38.569916 25973 raft_consensus.cc:504] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.570217 25973 leader_election.cc:288] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 117f5b9149f54119b34237107570ff92 (127.27.217.3:45343), 2bac879afadc4c5ca24d1f928e514067 (127.27.217.2:44505)
W20260809 16:19:38.572690 25549 tablet.cc:2369] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:19:38.573882 25958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.570465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:58391 (local address 127.27.217.3:45343)
0809 16:19:38.570519 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.570522 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.570533 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:19:38.570561 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.570562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.570571 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.570629 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:38.570772 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.571516 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.572929 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.573524 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.573612 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.573621 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.573776 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.573817 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 16:19:38.573882 25962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.570565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:38061 (local address 127.27.217.2:44505)
0809 16:19:38.570637 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.570639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.570649 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:19:38.570674 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.570675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.570684 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.570724 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:38.570854 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.571546 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.572988 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.573551 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.573614 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.573621 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.573776 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.573812 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 16:19:38.573897 25552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.570381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:45343 (local address 127.27.217.1:58391)
0809 16:19:38.570432 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.570445 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.570498 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.570633 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.570634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.570636 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:38.570706 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.570707 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.571584 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.571585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.572850 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.572854 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.573609 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.573610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.573704 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.573708 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.573761 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.573804 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":41}
I20260809 16:19:38.573906 25975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.570476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:44505 (local address 127.27.217.1:38061)
0809 16:19:38.570578 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.570586 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.570620 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.570737 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.570738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.570739 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:38.570798 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.570799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.571603 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.571603 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.572870 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.572872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.573610 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.573610 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.573704 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.573708 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.573761 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.573803 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":88,"thread_start_us":62,"threads_started":1}
I20260809 16:19:38.574281 25875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d50740ecbfb546fcba125a381255e8da" candidate_uuid: "87eb187eeda747778f45d94b45e261a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "117f5b9149f54119b34237107570ff92" is_pre_election: true
I20260809 16:19:38.574311 25677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d50740ecbfb546fcba125a381255e8da" candidate_uuid: "87eb187eeda747778f45d94b45e261a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bac879afadc4c5ca24d1f928e514067" is_pre_election: true
I20260809 16:19:38.574432 25677 raft_consensus.cc:2454] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87eb187eeda747778f45d94b45e261a1 in term 0.
I20260809 16:19:38.574433 25875 raft_consensus.cc:2454] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87eb187eeda747778f45d94b45e261a1 in term 0.
I20260809 16:19:38.574641 25404 leader_election.cc:302] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 117f5b9149f54119b34237107570ff92, 87eb187eeda747778f45d94b45e261a1; no voters:
I20260809 16:19:38.574748 25973 raft_consensus.cc:2781] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:19:38.574801 25973 raft_consensus.cc:482] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:19:38.574816 25973 raft_consensus.cc:3037] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:38.575526 25973 raft_consensus.cc:504] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.575639 25973 leader_election.cc:288] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [CANDIDATE]: Term 1 election: Requested vote from peers 117f5b9149f54119b34237107570ff92 (127.27.217.3:45343), 2bac879afadc4c5ca24d1f928e514067 (127.27.217.2:44505)
I20260809 16:19:38.575824 25875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d50740ecbfb546fcba125a381255e8da" candidate_uuid: "87eb187eeda747778f45d94b45e261a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "117f5b9149f54119b34237107570ff92"
I20260809 16:19:38.575826 25677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d50740ecbfb546fcba125a381255e8da" candidate_uuid: "87eb187eeda747778f45d94b45e261a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bac879afadc4c5ca24d1f928e514067"
I20260809 16:19:38.575899 25875 raft_consensus.cc:3037] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:38.575899 25677 raft_consensus.cc:3037] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:38.576582 25875 raft_consensus.cc:2454] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87eb187eeda747778f45d94b45e261a1 in term 1.
I20260809 16:19:38.576598 25677 raft_consensus.cc:2454] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87eb187eeda747778f45d94b45e261a1 in term 1.
I20260809 16:19:38.576735 25404 leader_election.cc:302] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bac879afadc4c5ca24d1f928e514067, 87eb187eeda747778f45d94b45e261a1; no voters:
I20260809 16:19:38.576830 25973 raft_consensus.cc:2781] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:38.576979 25973 raft_consensus.cc:686] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 1 LEADER]: Becoming Leader. State: Replica: 87eb187eeda747778f45d94b45e261a1, State: Running, Role: LEADER
I20260809 16:19:38.577064 25973 consensus_queue.cc:237] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } }
I20260809 16:19:38.577839 25292 catalog_manager.cc:5495] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87eb187eeda747778f45d94b45e261a1 (127.27.217.1). New cstate: current_term: 1 leader_uuid: "87eb187eeda747778f45d94b45e261a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87eb187eeda747778f45d94b45e261a1" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 36957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 } health_report { overall_health: UNKNOWN } } }
I20260809 16:19:38.593186 25960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.590940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45534 (local address 127.27.217.1:36957)
0809 16:19:38.590989 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.590991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.590999 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:38.591086 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.591087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.591103 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.591157 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:19:38.591279 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.591769 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.592457 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.592646 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.592700 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.592855 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:19:38.592952 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:19:38.593034 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.593089 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.593099 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 16:19:38.594720 25875 raft_consensus.cc:1261] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 1 FOLLOWER]: Refusing update from remote peer 87eb187eeda747778f45d94b45e261a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:38.594738 25677 raft_consensus.cc:1261] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 1 FOLLOWER]: Refusing update from remote peer 87eb187eeda747778f45d94b45e261a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:38.595037 25976 consensus_queue.cc:1035] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "117f5b9149f54119b34237107570ff92" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:38.595139 25973 consensus_queue.cc:1035] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bac879afadc4c5ca24d1f928e514067" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:38.597630 25981 mvcc.cc:205] Tried to move back new op lower bound from 7316653582721720320 to 7316653582652264448. Current Snapshot: MvccSnapshot[applied={T|T < 7316653582721720320}]
I20260809 16:19:38.598385 25982 mvcc.cc:205] Tried to move back new op lower bound from 7316653582721720320 to 7316653582652264448. Current Snapshot: MvccSnapshot[applied={T|T < 7316653582721720320}]
I20260809 16:19:38.599604 25289 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:38.599718 25289 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:38.600451 25289 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a778147088a24f28b2401d795ebfde73: Sending DeleteTablet for 3 replicas of tablet d50740ecbfb546fcba125a381255e8da
I20260809 16:19:38.600742 25844 tablet_service.cc:1514] Processing DeleteTablet for tablet d50740ecbfb546fcba125a381255e8da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:38 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:54260
I20260809 16:19:38.600772 25465 tablet_service.cc:1514] Processing DeleteTablet for tablet d50740ecbfb546fcba125a381255e8da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:38 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:45520
I20260809 16:19:38.600984 26000 tablet_replica.cc:330] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1: stopping tablet replica
I20260809 16:19:38.601004 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 25373
I20260809 16:19:38.601048 25631 tablet_service.cc:1514] Processing DeleteTablet for tablet d50740ecbfb546fcba125a381255e8da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:38 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:50162
I20260809 16:19:38.601071 26000 raft_consensus.cc:2229] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:19:38.601152 26000 raft_consensus.cc:2258] T d50740ecbfb546fcba125a381255e8da P 87eb187eeda747778f45d94b45e261a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:38.601220 26001 tablet_replica.cc:330] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: stopping tablet replica
I20260809 16:19:38.601292 26001 raft_consensus.cc:2229] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:38.601369 26001 raft_consensus.cc:2258] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:38.601675 25998 tablet_replica.cc:330] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: stopping tablet replica
I20260809 16:19:38.601761 25998 raft_consensus.cc:2229] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:38.601859 25998 raft_consensus.cc:2258] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:38.601862 26001 ts_tablet_manager.cc:1905] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:38.603293 26001 ts_tablet_manager.cc:1918] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:38.603355 26001 log.cc:1196] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/d50740ecbfb546fcba125a381255e8da
I20260809 16:19:38.603578 26001 ts_tablet_manager.cc:1939] T d50740ecbfb546fcba125a381255e8da P 2bac879afadc4c5ca24d1f928e514067: Deleting consensus metadata
I20260809 16:19:38.604002 25272 catalog_manager.cc:4841] TS 2bac879afadc4c5ca24d1f928e514067 (127.27.217.2:44505): tablet d50740ecbfb546fcba125a381255e8da (table test-table [id=a95ba1009321475f8c3dd65316606ac8]) successfully deleted
I20260809 16:19:38.604354 25998 ts_tablet_manager.cc:1905] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:38.606148 25998 ts_tablet_manager.cc:1918] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:38.606223 25998 log.cc:1196] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/d50740ecbfb546fcba125a381255e8da
I20260809 16:19:38.606534 25998 ts_tablet_manager.cc:1939] T d50740ecbfb546fcba125a381255e8da P 117f5b9149f54119b34237107570ff92: Deleting consensus metadata
I20260809 16:19:38.606971 25272 catalog_manager.cc:4841] TS 117f5b9149f54119b34237107570ff92 (127.27.217.3:45343): tablet d50740ecbfb546fcba125a381255e8da (table test-table [id=a95ba1009321475f8c3dd65316606ac8]) successfully deleted
W20260809 16:19:38.614897 25273 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:36957 (error 108)
I20260809 16:19:38.615095 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 25555
I20260809 16:19:38.616736 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.615244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:36957 (local address 127.0.0.1:45544)
0809 16:19:38.616663 (+ 1419us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.616704 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:36957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1398}
W20260809 16:19:38.616865 25273 catalog_manager.cc:4584] TS 87eb187eeda747778f45d94b45e261a1 (127.27.217.1:36957): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d50740ecbfb546fcba125a381255e8da: Network error: Client connection negotiation failed: client connection to 127.27.217.1:36957: connect: Connection refused (error 111)
I20260809 16:19:38.621603 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 25748
I20260809 16:19:38.635792 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 25248
2026-08-09T16:19:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2128 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T16:19:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:38Z Disabled control of system clock
I20260809 16:19:38.667151 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45349
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:40039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:45349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:38.747088 26006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:38.747298 26006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:38.747315 26006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:38.748425 26006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:38.748459 26006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:38.748471 26006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:38.748481 26006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:38.748492 26006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:38.749805 26006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:45349
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:45349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:38.750010 26006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:38.750249 26006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:38.755018 26021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:38.755054 26016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:38.755129 26006 server_base.cc:1034] running on GCE node
W20260809 16:19:38.755142 26017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:38.755491 26006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:38.755795 26006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:38.756929 26006 hybrid_clock.cc:648] HybridClock initialized: now 1786292378756917 us; error 30 us; skew 500 ppm
I20260809 16:19:38.758049 26006 webserver.cc:460] Webserver started at http://127.27.217.62:38979/ using document root <none> and password file <none>
I20260809 16:19:38.758270 26006 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:38.758314 26006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:38.758450 26006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:38.759500 26006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "34de41b699d347d6991b4b925434bd57"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "f73e9c2301eb53691be01c2db96a3809"
server_key_iv: "8ed69f7ea490feb66658bba143fa34ef"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.759857 26006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "34de41b699d347d6991b4b925434bd57"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "f73e9c2301eb53691be01c2db96a3809"
server_key_iv: "8ed69f7ea490feb66658bba143fa34ef"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.761108 26006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:19:38.761837 26030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.761976 26006 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:38.762055 26006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "34de41b699d347d6991b4b925434bd57"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "f73e9c2301eb53691be01c2db96a3809"
server_key_iv: "8ed69f7ea490feb66658bba143fa34ef"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.762120 26006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:38.776342 26006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:38.776603 26006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:38.776724 26006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:38.780408 26006 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:45349
I20260809 16:19:38.780447 26116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:45349 every 8 connection(s)
I20260809 16:19:38.780741 26006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:38.781411 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 26006
I20260809 16:19:38.781541 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:38.781775 26117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:38.781792 28516 external_mini_cluster.cc:1428] Setting key dd14b6092bc1794331ca360793401223
I20260809 16:19:38.784487 26117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57: Bootstrap starting.
I20260809 16:19:38.785055 26117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:38.785331 26117 log.cc:824] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:38.786057 26117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57: No bootstrap required, opened a new log
I20260809 16:19:38.787859 26117 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34de41b699d347d6991b4b925434bd57" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45349 } }
I20260809 16:19:38.787997 26117 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:38.788018 26117 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34de41b699d347d6991b4b925434bd57, State: Initialized, Role: FOLLOWER
I20260809 16:19:38.788115 26117 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34de41b699d347d6991b4b925434bd57" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45349 } }
I20260809 16:19:38.788182 26117 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:38.788209 26117 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:38.788239 26117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:38.788690 26117 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34de41b699d347d6991b4b925434bd57" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45349 } }
I20260809 16:19:38.788771 26117 leader_election.cc:302] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34de41b699d347d6991b4b925434bd57; no voters:
I20260809 16:19:38.788914 26117 leader_election.cc:288] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:38.788976 26124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:38.789142 26124 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [term 1 LEADER]: Becoming Leader. State: Replica: 34de41b699d347d6991b4b925434bd57, State: Running, Role: LEADER
I20260809 16:19:38.789142 26117 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:38.789273 26124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34de41b699d347d6991b4b925434bd57" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45349 } }
I20260809 16:19:38.789641 26127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34de41b699d347d6991b4b925434bd57. Latest consensus state: current_term: 1 leader_uuid: "34de41b699d347d6991b4b925434bd57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34de41b699d347d6991b4b925434bd57" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45349 } } }
I20260809 16:19:38.789793 26127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:38.789661 26125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34de41b699d347d6991b4b925434bd57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34de41b699d347d6991b4b925434bd57" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 45349 } } }
I20260809 16:19:38.789990 26125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:38.790511 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.782302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33422 (local address 127.27.217.62:45349)
0809 16:19:38.782496 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.782503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.782527 (+ 24us) server_negotiation.cc:407] Connection header received
0809 16:19:38.783081 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.783087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.783145 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.783266 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:38.783485 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.784382 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.785222 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.785741 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.785869 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.789770 (+ 3901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:38.789774 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:38.789775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:38.789986 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:38.790028 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:38.790044 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:38.790105 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.790199 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.790297 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
W20260809 16:19:38.791196 26147 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:19:38.791251 26147 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:19:38.791301 26136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:38.791478 26136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:38.792835 26136 catalog_manager.cc:1347] Generated new cluster ID: d9e7413b56f245b888ca94518da98c12
I20260809 16:19:38.792892 26136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:38.802882 26136 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:38.803541 26136 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:38.810256 26136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57: Generated new TSK 0
I20260809 16:19:38.810418 26136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:38.818127 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45349
--builtin_ntp_servers=127.27.217.20:40039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:38.914598 26158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:38.914793 26158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:38.914813 26158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:38.915961 26158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:38.916000 26158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:38.916024 26158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:19:38.917352 26158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:38.917567 26158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:38.917848 26158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:38.923460 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:38.923504 26158 server_base.cc:1034] running on GCE node
W20260809 16:19:38.923601 26170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:38.923470 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:38.923887 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:38.924160 26158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:38.925338 26158 hybrid_clock.cc:648] HybridClock initialized: now 1786292378925313 us; error 37 us; skew 500 ppm
I20260809 16:19:38.926780 26158 webserver.cc:460] Webserver started at http://127.27.217.1:42521/ using document root <none> and password file <none>
I20260809 16:19:38.927026 26158 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:38.927094 26158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:38.927237 26158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:38.928685 26158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "06d81a939fab4213a8d6f17452c61448"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "f92bafdbbb7cfcff89733ccad047f94c"
server_key_iv: "b8107cc236809f16c75c8b17b15acc23"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.929101 26158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "06d81a939fab4213a8d6f17452c61448"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "f92bafdbbb7cfcff89733ccad047f94c"
server_key_iv: "b8107cc236809f16c75c8b17b15acc23"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.930681 26158 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:38.931448 26183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.931602 26158 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:38.931715 26158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "06d81a939fab4213a8d6f17452c61448"
format_stamp: "Formatted at 2026-08-09 16:19:38 on dist-test-slave-nj21"
server_key: "f92bafdbbb7cfcff89733ccad047f94c"
server_key_iv: "b8107cc236809f16c75c8b17b15acc23"
server_key_version: "encryptionkey@0"
I20260809 16:19:38.931782 26158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:38.964284 26158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:38.964555 26158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:38.964679 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:38.964912 26158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:38.965227 26158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:38.965261 26158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.965283 26158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:38.965307 26158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:38.970721 26158 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:35739
I20260809 16:19:38.970779 26348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:35739 every 8 connection(s)
I20260809 16:19:38.971076 26158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:19:38.975768 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.971729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:56075 (local address 127.27.217.62:45349)
0809 16:19:38.971787 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:38.971788 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:38.972010 (+ 222us) server_negotiation.cc:407] Connection header received
0809 16:19:38.972456 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:38.972457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:38.972470 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:38.972522 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:38.973137 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.973628 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.974584 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.974762 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.974803 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.975538 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:38.975538 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:38.975538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:38.975542 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:38.975552 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:38.975555 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:38.975583 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:38.975641 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 16:19:38.975659 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 16:19:38.975900 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:38.971713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45349 (local address 127.27.217.1:56075)
0809 16:19:38.971889 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:38.971921 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:38.972381 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:38.972574 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:38.972577 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:38.972585 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:38.973078 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.973083 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.973734 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.973735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.974517 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:38.974519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:38.974818 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:38.974818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:38.974917 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:38.975424 (+ 507us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:38.975424 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:38.975451 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:38.975473 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:38.975590 (+ 117us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:38.975591 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:38.975594 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:38.975635 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 16:19:38.975722 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
I20260809 16:19:38.976347 26349 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45349
I20260809 16:19:38.976425 26349 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:38.976588 26349 heartbeater.cc:511] Master 127.27.217.62:45349 requested a full tablet report, sending...
I20260809 16:19:38.976909 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 26158
I20260809 16:19:38.977011 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:19:38.977089 26060 ts_manager.cc:194] Registered new tserver with Master: 06d81a939fab4213a8d6f17452c61448 (127.27.217.1:35739)
I20260809 16:19:38.977216 28516 external_mini_cluster.cc:1428] Setting key d30185f19156d6d5a35916e0fa6dd366
I20260809 16:19:38.977703 26060 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.1:56075
I20260809 16:19:38.978291 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45349
--builtin_ntp_servers=127.27.217.20:40039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:39.057809 26353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:39.058003 26353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:39.058023 26353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:39.059134 26353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:39.059168 26353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:39.059194 26353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:19:39.060549 26353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:39.060766 26353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:39.061054 26353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:39.065836 26362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:39.065867 26370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:39.065776 26367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:39.066080 26353 server_base.cc:1034] running on GCE node
I20260809 16:19:39.066277 26353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:39.066498 26353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:39.067651 26353 hybrid_clock.cc:648] HybridClock initialized: now 1786292379067634 us; error 26 us; skew 500 ppm
I20260809 16:19:39.069005 26353 webserver.cc:460] Webserver started at http://127.27.217.2:39153/ using document root <none> and password file <none>
I20260809 16:19:39.069250 26353 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:39.069303 26353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:39.069439 26353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:39.070536 26353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "11affb51306d4442a7e3b91f823e1e19"
format_stamp: "Formatted at 2026-08-09 16:19:39 on dist-test-slave-nj21"
server_key: "aaf76d6d5b94b042a0b3d9f340b815b6"
server_key_iv: "f2f6d8b2946fd616654861596b767879"
server_key_version: "encryptionkey@0"
I20260809 16:19:39.070888 26353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "11affb51306d4442a7e3b91f823e1e19"
format_stamp: "Formatted at 2026-08-09 16:19:39 on dist-test-slave-nj21"
server_key: "aaf76d6d5b94b042a0b3d9f340b815b6"
server_key_iv: "f2f6d8b2946fd616654861596b767879"
server_key_version: "encryptionkey@0"
I20260809 16:19:39.072330 26353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 16:19:39.073035 26378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:39.073172 26353 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:39.073257 26353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "11affb51306d4442a7e3b91f823e1e19"
format_stamp: "Formatted at 2026-08-09 16:19:39 on dist-test-slave-nj21"
server_key: "aaf76d6d5b94b042a0b3d9f340b815b6"
server_key_iv: "f2f6d8b2946fd616654861596b767879"
server_key_version: "encryptionkey@0"
I20260809 16:19:39.073324 26353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:39.090612 26353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:39.090929 26353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:39.091061 26353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:39.091290 26353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:39.091614 26353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:39.091648 26353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:39.091697 26353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:39.091732 26353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:39.097350 26353 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:45409
I20260809 16:19:39.097410 26545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:45409 every 8 connection(s)
I20260809 16:19:39.097757 26353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:19:39.103159 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 26353
I20260809 16:19:39.103255 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:19:39.103508 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.098475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:49415 (local address 127.27.217.62:45349)
0809 16:19:39.098559 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.098561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.098726 (+ 165us) server_negotiation.cc:407] Connection header received
0809 16:19:39.099337 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.099345 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.099358 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.099475 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:39.100510 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.101012 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.102054 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.102239 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.102296 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.103189 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:39.103191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:39.103192 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:39.103196 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:39.103213 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:39.103217 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:39.103271 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.103384 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.103416 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 16:19:39.103549 28516 external_mini_cluster.cc:1428] Setting key 80dd474771be9a688a99f3d96a923f9c
I20260809 16:19:39.103744 26548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.098443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45349 (local address 127.27.217.2:49415)
0809 16:19:39.098604 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:39.098639 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:39.099234 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:39.099591 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:39.099595 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:39.099611 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:39.100421 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.100427 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.101116 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.101117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.101972 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.101975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.102333 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.102334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.102454 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.103041 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:39.103042 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:39.103078 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:39.103101 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:39.103297 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:39.103302 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:39.103305 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:39.103369 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 16:19:39.103481 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
I20260809 16:19:39.104241 26546 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45349
I20260809 16:19:39.104327 26546 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:39.104504 26546 heartbeater.cc:511] Master 127.27.217.62:45349 requested a full tablet report, sending...
I20260809 16:19:39.104632 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45349
--builtin_ntp_servers=127.27.217.20:40039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 16:19:39.104864 26060 ts_manager.cc:194] Registered new tserver with Master: 11affb51306d4442a7e3b91f823e1e19 (127.27.217.2:45409)
I20260809 16:19:39.105223 26060 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.2:49415
W20260809 16:19:39.185149 26549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:39.185345 26549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:39.185365 26549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:39.186462 26549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:39.186499 26549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:39.186522 26549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:19:39.187844 26549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:45349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:39.188051 26549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:39.188321 26549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:39.193127 26559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:39.193166 26555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:39.193240 26549 server_base.cc:1034] running on GCE node
W20260809 16:19:39.193315 26556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:39.193522 26549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:39.193733 26549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:39.194875 26549 hybrid_clock.cc:648] HybridClock initialized: now 1786292379194854 us; error 37 us; skew 500 ppm
I20260809 16:19:39.196158 26549 webserver.cc:460] Webserver started at http://127.27.217.3:37021/ using document root <none> and password file <none>
I20260809 16:19:39.196386 26549 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:39.196435 26549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:39.196556 26549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:39.197556 26549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "c7a2d285c86c4dc6a166d6802a477368"
format_stamp: "Formatted at 2026-08-09 16:19:39 on dist-test-slave-nj21"
server_key: "98c3da3d637cd0604f8c3e46ff4f9b1d"
server_key_iv: "583e8edb721457919a13abbf5ef0aa49"
server_key_version: "encryptionkey@0"
I20260809 16:19:39.197899 26549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "c7a2d285c86c4dc6a166d6802a477368"
format_stamp: "Formatted at 2026-08-09 16:19:39 on dist-test-slave-nj21"
server_key: "98c3da3d637cd0604f8c3e46ff4f9b1d"
server_key_iv: "583e8edb721457919a13abbf5ef0aa49"
server_key_version: "encryptionkey@0"
I20260809 16:19:39.199070 26549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 16:19:39.199707 26569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:39.199846 26549 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:39.199919 26549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "c7a2d285c86c4dc6a166d6802a477368"
format_stamp: "Formatted at 2026-08-09 16:19:39 on dist-test-slave-nj21"
server_key: "98c3da3d637cd0604f8c3e46ff4f9b1d"
server_key_iv: "583e8edb721457919a13abbf5ef0aa49"
server_key_version: "encryptionkey@0"
I20260809 16:19:39.199982 26549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:39.212023 26549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:39.212296 26549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:39.212417 26549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:39.212623 26549 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:39.212929 26549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:39.212961 26549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:39.212989 26549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:39.213012 26549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:39.218360 26549 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:35467
I20260809 16:19:39.218405 26735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:35467 every 8 connection(s)
I20260809 16:19:39.218701 26549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:19:39.219615 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 26549
I20260809 16:19:39.219743 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:19:39.219935 28516 external_mini_cluster.cc:1428] Setting key b2e9f0174956fa4a65a6146cd565b137
I20260809 16:19:39.223855 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.219374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:39767 (local address 127.27.217.62:45349)
0809 16:19:39.219432 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.219434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.219686 (+ 252us) server_negotiation.cc:407] Connection header received
0809 16:19:39.220280 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.220281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.220293 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.220348 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:39.221066 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.221601 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.222543 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.222745 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.222799 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.223557 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:39.223558 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:39.223559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:39.223563 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:39.223578 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:39.223582 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:39.223626 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.223747 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.223774 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:19:39.224054 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.219345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:45349 (local address 127.27.217.3:39767)
0809 16:19:39.219550 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:39.219590 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:39.220175 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:39.220418 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:39.220422 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:39.220432 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:39.220979 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.220984 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.221691 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.221692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.222461 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.222463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.222812 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.222813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.222941 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.223411 (+ 470us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:39.223412 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:39.223439 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:39.223461 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:39.223633 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:39.223638 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:39.223642 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:39.223730 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 16:19:39.223849 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":86,"threads_started":1}
I20260809 16:19:39.224434 26736 heartbeater.cc:347] Connected to a master server at 127.27.217.62:45349
I20260809 16:19:39.224514 26736 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:39.224656 26736 heartbeater.cc:511] Master 127.27.217.62:45349 requested a full tablet report, sending...
I20260809 16:19:39.224958 26060 ts_manager.cc:194] Registered new tserver with Master: c7a2d285c86c4dc6a166d6802a477368 (127.27.217.3:35467)
I20260809 16:19:39.225283 26060 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.3:39767
I20260809 16:19:39.231597 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:19:39.235829 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.232937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33434 (local address 127.27.217.62:45349)
0809 16:19:39.233001 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.233003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.233119 (+ 116us) server_negotiation.cc:407] Connection header received
0809 16:19:39.233188 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.233189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.233200 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.233241 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:39.233431 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.233905 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.234647 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.234833 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.234885 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.235491 (+ 606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:39.235493 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:39.235493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:39.235497 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:39.235512 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:39.235515 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:39.235589 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.235661 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.235746 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 16:19:39.237324 26060 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:19:39.238888 26060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:19:39.245136 26749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.241261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:45409 (local address 127.0.0.1:52030)
0809 16:19:39.241645 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:39.241652 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:39.241696 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:39.242049 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:39.242049 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:39.242053 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:39.242087 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.242088 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.242899 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.242900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.244159 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.244162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.244856 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.244857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.244931 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.244944 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 16:19:39.245010 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 16:19:39.245062 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":48,"thread_start_us":66,"threads_started":1}
I20260809 16:19:39.245147 26753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.241369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52030 (local address 127.27.217.2:45409)
0809 16:19:39.241551 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.241554 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.241846 (+ 292us) server_negotiation.cc:407] Connection header received
0809 16:19:39.241894 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.241896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.241912 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.241981 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:39.242151 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.242828 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.244260 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.244783 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.244846 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.244940 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.245026 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.245062 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":78,"threads_started":1}
I20260809 16:19:39.245430 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.241052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:35467 (local address 127.0.0.1:57134)
0809 16:19:39.241426 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:39.241469 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:39.241534 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:39.241809 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:39.241812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:39.241815 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:39.241882 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.241884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.243169 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.243169 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.244287 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.244289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.245221 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.245222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.245279 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.245283 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:39.245327 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:19:39.245365 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":30,"thread_start_us":74,"threads_started":1}
I20260809 16:19:39.245476 26750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.241142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46406 (local address 127.27.217.1:35739)
0809 16:19:39.241324 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.241330 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.241611 (+ 281us) server_negotiation.cc:407] Connection header received
0809 16:19:39.241659 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.241661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.241697 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.241775 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:39.241965 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.243086 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.244184 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.244872 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.244942 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.245027 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.245353 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.245398 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":103,"threads_started":1}
I20260809 16:19:39.245743 26751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.241052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:35739 (local address 127.0.0.1:46406)
0809 16:19:39.241540 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:39.241549 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:39.241603 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:39.241847 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:39.241848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:39.241849 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:39.241882 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.241886 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.243183 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.243184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.244108 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.244110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.245066 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.245067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.245126 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.245130 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:39.245644 (+ 514us) client_negotiation.cc:240] Negotiation successful
0809 16:19:39.245684 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":76,"threads_started":1}
I20260809 16:19:39.245735 26752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.241338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57134 (local address 127.27.217.3:35467)
0809 16:19:39.241509 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.241513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.241526 (+ 13us) server_negotiation.cc:407] Connection header received
0809 16:19:39.241619 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.241621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.241637 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.241727 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:39.241961 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.243093 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.244362 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.245053 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.245112 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.245189 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.245614 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.245658 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260809 16:19:39.245838 26447 tablet_service.cc:1467] Processing CreateTablet for tablet bd3c6624d1b14f38b3f81102e3ec0c31 (DEFAULT_TABLE table=test-table [id=4713510e8ba040949b2db82636ba0c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:39.246268 26447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3c6624d1b14f38b3f81102e3ec0c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:39.246325 26636 tablet_service.cc:1467] Processing CreateTablet for tablet bd3c6624d1b14f38b3f81102e3ec0c31 (DEFAULT_TABLE table=test-table [id=4713510e8ba040949b2db82636ba0c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:39.246510 26259 tablet_service.cc:1467] Processing CreateTablet for tablet bd3c6624d1b14f38b3f81102e3ec0c31 (DEFAULT_TABLE table=test-table [id=4713510e8ba040949b2db82636ba0c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:39.246657 26636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3c6624d1b14f38b3f81102e3ec0c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:39.246865 26259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3c6624d1b14f38b3f81102e3ec0c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:39.249378 26754 tablet_bootstrap.cc:492] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: Bootstrap starting.
I20260809 16:19:39.249763 26755 tablet_bootstrap.cc:492] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Bootstrap starting.
I20260809 16:19:39.250187 26754 tablet_bootstrap.cc:654] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:39.250211 26757 tablet_bootstrap.cc:492] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448: Bootstrap starting.
I20260809 16:19:39.250389 26755 tablet_bootstrap.cc:654] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:39.250600 26754 log.cc:824] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:39.250695 26755 log.cc:824] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:39.250813 26757 tablet_bootstrap.cc:654] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:39.251132 26757 log.cc:824] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:39.251392 26754 tablet_bootstrap.cc:492] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: No bootstrap required, opened a new log
I20260809 16:19:39.251391 26755 tablet_bootstrap.cc:492] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: No bootstrap required, opened a new log
I20260809 16:19:39.251464 26755 ts_tablet_manager.cc:1397] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:39.251464 26754 ts_tablet_manager.cc:1397] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:39.251832 26757 tablet_bootstrap.cc:492] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448: No bootstrap required, opened a new log
I20260809 16:19:39.251892 26757 ts_tablet_manager.cc:1397] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:39.253702 26757 raft_consensus.cc:348] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.253839 26757 raft_consensus.cc:374] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:39.253872 26757 raft_consensus.cc:729] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06d81a939fab4213a8d6f17452c61448, State: Initialized, Role: FOLLOWER
I20260809 16:19:39.253986 26757 consensus_queue.cc:260] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.253959 26754 raft_consensus.cc:348] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.253959 26755 raft_consensus.cc:348] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.254113 26754 raft_consensus.cc:374] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:39.254113 26755 raft_consensus.cc:374] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:39.254148 26754 raft_consensus.cc:729] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a2d285c86c4dc6a166d6802a477368, State: Initialized, Role: FOLLOWER
I20260809 16:19:39.254148 26755 raft_consensus.cc:729] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11affb51306d4442a7e3b91f823e1e19, State: Initialized, Role: FOLLOWER
I20260809 16:19:39.254230 26757 ts_tablet_manager.cc:1428] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:19:39.254278 26755 consensus_queue.cc:260] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.254364 26349 heartbeater.cc:503] Master 127.27.217.62:45349 was elected leader, sending a full tablet report...
I20260809 16:19:39.254545 26755 ts_tablet_manager.cc:1428] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:19:39.254580 26546 heartbeater.cc:503] Master 127.27.217.62:45349 was elected leader, sending a full tablet report...
I20260809 16:19:39.254308 26754 consensus_queue.cc:260] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.254869 26754 ts_tablet_manager.cc:1428] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:19:39.254972 26736 heartbeater.cc:503] Master 127.27.217.62:45349 was elected leader, sending a full tablet report...
W20260809 16:19:39.348305 26547 tablet.cc:2369] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:19:39.350098 26764 raft_consensus.cc:482] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:39.350193 26764 raft_consensus.cc:504] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.350557 26764 leader_election.cc:288] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7a2d285c86c4dc6a166d6802a477368 (127.27.217.3:35467), 06d81a939fab4213a8d6f17452c61448 (127.27.217.1:35739)
I20260809 16:19:39.353295 26750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.350830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:49301 (local address 127.27.217.1:35739)
0809 16:19:39.350877 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.350879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.350886 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:19:39.350916 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.350917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.350928 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.350984 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:39.351129 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.351597 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.352618 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.352984 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.353048 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.353057 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.353189 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.353222 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:19:39.353295 26548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.350724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:35739 (local address 127.27.217.2:49301)
0809 16:19:39.350771 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:39.350783 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:39.350831 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:39.350990 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:39.350991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:39.350992 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:39.351063 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.351065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.351688 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.351689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.352530 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.352533 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.353058 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.353059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.353129 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.353133 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:39.353178 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 16:19:39.353222 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":34}
I20260809 16:19:39.353379 26752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.350861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:39135 (local address 127.27.217.3:35467)
0809 16:19:39.350922 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.350924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.351022 (+ 98us) server_negotiation.cc:407] Connection header received
0809 16:19:39.351080 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.351081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.351090 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.351136 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:39.351280 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.351783 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.352690 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.353055 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.353117 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.353126 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.353268 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.353309 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 16:19:39.353583 26766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.350732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:35467 (local address 127.27.217.2:39135)
0809 16:19:39.350948 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:39.350957 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:39.351017 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:39.351146 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:39.351146 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:39.351147 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:39.351218 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.351220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.351855 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.351856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.352605 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:39.352607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.353134 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.353135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:39.353205 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.353208 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:39.353261 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 16:19:39.353299 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":16,"thread_start_us":115,"threads_started":1}
I20260809 16:19:39.353655 26284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6624d1b14f38b3f81102e3ec0c31" candidate_uuid: "11affb51306d4442a7e3b91f823e1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06d81a939fab4213a8d6f17452c61448" is_pre_election: true
I20260809 16:19:39.353829 26284 raft_consensus.cc:2454] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11affb51306d4442a7e3b91f823e1e19 in term 0.
I20260809 16:19:39.353921 26666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6624d1b14f38b3f81102e3ec0c31" candidate_uuid: "11affb51306d4442a7e3b91f823e1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a2d285c86c4dc6a166d6802a477368" is_pre_election: true
I20260809 16:19:39.354079 26666 raft_consensus.cc:2454] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11affb51306d4442a7e3b91f823e1e19 in term 0.
I20260809 16:19:39.354102 26384 leader_election.cc:302] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06d81a939fab4213a8d6f17452c61448, 11affb51306d4442a7e3b91f823e1e19; no voters:
I20260809 16:19:39.354210 26764 raft_consensus.cc:2781] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:19:39.354262 26764 raft_consensus.cc:482] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:19:39.354277 26764 raft_consensus.cc:3037] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:39.354992 26764 raft_consensus.cc:504] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.355109 26764 leader_election.cc:288] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [CANDIDATE]: Term 1 election: Requested vote from peers c7a2d285c86c4dc6a166d6802a477368 (127.27.217.3:35467), 06d81a939fab4213a8d6f17452c61448 (127.27.217.1:35739)
I20260809 16:19:39.355268 26284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6624d1b14f38b3f81102e3ec0c31" candidate_uuid: "11affb51306d4442a7e3b91f823e1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06d81a939fab4213a8d6f17452c61448"
I20260809 16:19:39.355273 26666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3c6624d1b14f38b3f81102e3ec0c31" candidate_uuid: "11affb51306d4442a7e3b91f823e1e19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a2d285c86c4dc6a166d6802a477368"
I20260809 16:19:39.355340 26284 raft_consensus.cc:3037] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:39.355351 26666 raft_consensus.cc:3037] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:39.356142 26284 raft_consensus.cc:2454] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11affb51306d4442a7e3b91f823e1e19 in term 1.
I20260809 16:19:39.356158 26666 raft_consensus.cc:2454] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11affb51306d4442a7e3b91f823e1e19 in term 1.
I20260809 16:19:39.356316 26387 leader_election.cc:302] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11affb51306d4442a7e3b91f823e1e19, c7a2d285c86c4dc6a166d6802a477368; no voters:
I20260809 16:19:39.356436 26764 raft_consensus.cc:2781] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:39.356587 26764 raft_consensus.cc:686] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 1 LEADER]: Becoming Leader. State: Replica: 11affb51306d4442a7e3b91f823e1e19, State: Running, Role: LEADER
I20260809 16:19:39.356678 26764 consensus_queue.cc:237] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } }
I20260809 16:19:39.357514 26059 catalog_manager.cc:5495] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11affb51306d4442a7e3b91f823e1e19 (127.27.217.2). New cstate: current_term: 1 leader_uuid: "11affb51306d4442a7e3b91f823e1e19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11affb51306d4442a7e3b91f823e1e19" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 } health_report { overall_health: UNKNOWN } } }
I20260809 16:19:39.391527 26753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.389078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52032 (local address 127.27.217.2:45409)
0809 16:19:39.389134 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:39.389136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:39.389143 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:19:39.389176 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:39.389177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:39.389197 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:39.389256 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:19:39.389383 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.389972 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.390773 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:39.390967 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:39.391023 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:39.391187 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:19:39.391278 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:19:39.391363 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:39.391409 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 16:19:39.391418 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:19:39.393342 26666 raft_consensus.cc:1261] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 1 FOLLOWER]: Refusing update from remote peer 11affb51306d4442a7e3b91f823e1e19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:39.393342 26284 raft_consensus.cc:1261] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [term 1 FOLLOWER]: Refusing update from remote peer 11affb51306d4442a7e3b91f823e1e19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:39.393702 26767 consensus_queue.cc:1035] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06d81a939fab4213a8d6f17452c61448" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 35739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:39.393837 26764 consensus_queue.cc:1035] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7a2d285c86c4dc6a166d6802a477368" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 35467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:39.396170 26771 mvcc.cc:205] Tried to move back new op lower bound from 7316653585992396800 to 7316653585845510144. Current Snapshot: MvccSnapshot[applied={T|T < 7316653585992396800}]
I20260809 16:19:39.396380 26772 mvcc.cc:205] Tried to move back new op lower bound from 7316653585992396800 to 7316653585845510144. Current Snapshot: MvccSnapshot[applied={T|T < 7316653585992396800}]
I20260809 16:19:39.397015 26774 mvcc.cc:205] Tried to move back new op lower bound from 7316653585992396800 to 7316653585845510144. Current Snapshot: MvccSnapshot[applied={T|T < 7316653585992396800}]
I20260809 16:19:39.398969 26059 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:39.399051 26059 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:39.399765 26059 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34de41b699d347d6991b4b925434bd57: Sending DeleteTablet for 3 replicas of tablet bd3c6624d1b14f38b3f81102e3ec0c31
I20260809 16:19:39.400092 26447 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3c6624d1b14f38b3f81102e3ec0c31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:39 UTC) from {username='slave'} at 127.0.0.1:52030
I20260809 16:19:39.400141 26259 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3c6624d1b14f38b3f81102e3ec0c31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:39 UTC) from {username='slave'} at 127.0.0.1:46406
I20260809 16:19:39.400315 26781 tablet_replica.cc:330] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: stopping tablet replica
I20260809 16:19:39.400417 26781 raft_consensus.cc:2229] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:19:39.400388 26636 tablet_service.cc:1514] Processing DeleteTablet for tablet bd3c6624d1b14f38b3f81102e3ec0c31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:39 UTC) from {username='slave'} at 127.0.0.1:57134
I20260809 16:19:39.400426 26782 tablet_replica.cc:330] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448: stopping tablet replica
I20260809 16:19:39.400523 26781 raft_consensus.cc:2258] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:39.400640 26782 raft_consensus.cc:2229] T bd3c6624d1b14f38b3f81102e3ec0c31 P 06d81a939fab4213a8d6f17452c61448 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:39.400861 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 26158
I20260809 16:19:39.400969 26781 ts_tablet_manager.cc:1905] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:39.403080 26781 ts_tablet_manager.cc:1918] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:39.403132 26781 log.cc:1196] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/bd3c6624d1b14f38b3f81102e3ec0c31
I20260809 16:19:39.403317 26781 ts_tablet_manager.cc:1939] T bd3c6624d1b14f38b3f81102e3ec0c31 P 11affb51306d4442a7e3b91f823e1e19: Deleting consensus metadata
I20260809 16:19:39.403637 26039 catalog_manager.cc:4841] TS 11affb51306d4442a7e3b91f823e1e19 (127.27.217.2:45409): tablet bd3c6624d1b14f38b3f81102e3ec0c31 (table test-table [id=4713510e8ba040949b2db82636ba0c8a]) successfully deleted
I20260809 16:19:39.402976 26783 tablet_replica.cc:330] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: stopping tablet replica
I20260809 16:19:39.403836 26783 raft_consensus.cc:2229] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:39.403929 26783 raft_consensus.cc:2258] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:39.410877 26783 ts_tablet_manager.cc:1905] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:39.412264 26783 ts_tablet_manager.cc:1918] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:39.412328 26783 log.cc:1196] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/bd3c6624d1b14f38b3f81102e3ec0c31
I20260809 16:19:39.412519 26783 ts_tablet_manager.cc:1939] T bd3c6624d1b14f38b3f81102e3ec0c31 P c7a2d285c86c4dc6a166d6802a477368: Deleting consensus metadata
I20260809 16:19:39.412889 26039 catalog_manager.cc:4841] TS c7a2d285c86c4dc6a166d6802a477368 (127.27.217.3:35467): tablet bd3c6624d1b14f38b3f81102e3ec0c31 (table test-table [id=4713510e8ba040949b2db82636ba0c8a]) successfully deleted
W20260809 16:19:39.417132 26037 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:35739 (error 108)
I20260809 16:19:39.417389 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 26353
I20260809 16:19:39.419063 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:39.417465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:35739 (local address 127.0.0.1:46412)
0809 16:19:39.418976 (+ 1511us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:39.419028 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:35739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1488}
W20260809 16:19:39.421756 26037 catalog_manager.cc:4584] TS 06d81a939fab4213a8d6f17452c61448 (127.27.217.1:35739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd3c6624d1b14f38b3f81102e3ec0c31: Network error: Client connection negotiation failed: client connection to 127.27.217.1:35739: connect: Connection refused (error 111)
I20260809 16:19:39.425114 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 26549
I20260809 16:19:39.435940 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 26006
2026-08-09T16:19:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (797 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:39 dist-test-slave-nj21 krb5kdc[26787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:39 dist-test-slave-nj21 krb5kdc[26787](info): set up 2 sockets
Aug 09 16:19:39 dist-test-slave-nj21 krb5kdc[26787](info): commencing operation
krb5kdc: starting...
W20260809 16:19:40.591183 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:40 dist-test-slave-nj21 krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:19:40.704407 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:40127
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:40127
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:40.785743 26807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:40.785955 26807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:40.785989 26807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:40.787106 26807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:40.787147 26807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:40.787165 26807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:40.787182 26807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:40.787196 26807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:40.788695 26807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:40127
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:40127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:40.788938 26807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:40.789136 26807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:40.793522 26818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:40.793613 26814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:40.793584 26816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:40.793843 26807 server_base.cc:1034] running on GCE node
I20260809 16:19:40.794046 26807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:40.794273 26807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:40.795416 26807 hybrid_clock.cc:648] HybridClock initialized: now 1786292380795402 us; error 28 us; skew 500 ppm
Aug 09 16:19:40 dist-test-slave-nj21 krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292380, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:40.797816 26807 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:19:40.798198 26807 webserver.cc:460] Webserver started at http://127.27.217.62:38625/ using document root <none> and password file <none>
I20260809 16:19:40.798400 26807 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:40.798460 26807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:40.798583 26807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:40.799561 26807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6"
format_stamp: "Formatted at 2026-08-09 16:19:40 on dist-test-slave-nj21"
server_key: "d9828e3dde7a6c1cca18302c33541175"
server_key_iv: "10fae5a69470ca5d0b512e667097dce5"
server_key_version: "encryptionkey@0"
I20260809 16:19:40.799926 26807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6"
format_stamp: "Formatted at 2026-08-09 16:19:40 on dist-test-slave-nj21"
server_key: "d9828e3dde7a6c1cca18302c33541175"
server_key_iv: "10fae5a69470ca5d0b512e667097dce5"
server_key_version: "encryptionkey@0"
I20260809 16:19:40.801134 26807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:19:40.801764 26833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:40.801918 26807 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:40.802000 26807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6"
format_stamp: "Formatted at 2026-08-09 16:19:40 on dist-test-slave-nj21"
server_key: "d9828e3dde7a6c1cca18302c33541175"
server_key_iv: "10fae5a69470ca5d0b512e667097dce5"
server_key_version: "encryptionkey@0"
I20260809 16:19:40.802065 26807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:40.820995 26807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:40.823084 26807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:40.823220 26807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:40.827008 26807 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:40127
I20260809 16:19:40.827047 26902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:40127 every 8 connection(s)
I20260809 16:19:40.827360 26807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:40.828224 26903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:40.828871 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 26807
I20260809 16:19:40.828994 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:40.829180 28516 external_mini_cluster.cc:1428] Setting key f3a8a417f4504636e0321a06197e3b5f
I20260809 16:19:40.831174 26903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6: Bootstrap starting.
I20260809 16:19:40.831822 26903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:40.832093 26903 log.cc:824] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:40.832734 26903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6: No bootstrap required, opened a new log
I20260809 16:19:40.834472 26903 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40127 } }
I20260809 16:19:40.834604 26903 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:40.834625 26903 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b5689ca86b4cd1826d0713b5ecc7b6, State: Initialized, Role: FOLLOWER
I20260809 16:19:40.834733 26903 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40127 } }
I20260809 16:19:40.834802 26903 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:40.834824 26903 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:40.834867 26903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 16:19:40 dist-test-slave-nj21 krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:40.835362 26903 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40127 } }
I20260809 16:19:40.835475 26903 leader_election.cc:302] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3b5689ca86b4cd1826d0713b5ecc7b6; no voters:
I20260809 16:19:40.835623 26903 leader_election.cc:288] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:40.835687 26908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:40.835848 26908 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [term 1 LEADER]: Becoming Leader. State: Replica: d3b5689ca86b4cd1826d0713b5ecc7b6, State: Running, Role: LEADER
I20260809 16:19:40.835907 26903 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:40.835942 26908 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40127 } }
I20260809 16:19:40.836594 26909 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40127 } } }
I20260809 16:19:40.836688 26909 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:40.836613 26911 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3b5689ca86b4cd1826d0713b5ecc7b6. Latest consensus state: current_term: 1 leader_uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b5689ca86b4cd1826d0713b5ecc7b6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40127 } } }
I20260809 16:19:40.836922 26911 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6 [sys.catalog]: This master's current role is: LEADER
W20260809 16:19:40.837740 26929 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:19:40.837795 26929 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:19:40.837845 26922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:40.838019 26922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:40.839174 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:40.829692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42808 (local address 127.27.217.62:40127)
0809 16:19:40.829850 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:40.829859 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:40.829884 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:19:40.830291 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:40.830297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:40.830348 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:40.830463 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:40.831229 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:40.832240 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:40.833001 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:40.833406 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:40.833499 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:40.835847 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:40.835862 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:40.835862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:40.835875 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:40.837738 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:40.838117 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:40.838120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:40.838121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:40.838205 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:40.838381 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:40.838382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:40.838382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:40.838605 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:40.838723 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:40.838844 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 16:19:40.838973 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260809 16:19:40.839459 26922 catalog_manager.cc:1347] Generated new cluster ID: df729e981678423eae7bb9f74c058dc7
I20260809 16:19:40.839500 26922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:40.848470 26922 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:40.848953 26922 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:40.853662 26922 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6: Generated new TSK 0
I20260809 16:19:40.853802 26922 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.217.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
Entry for principal kudu/127.27.217.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab.
I20260809 16:19:40.878417 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:40127
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:40.957880 26935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:40.958067 26935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:40.958089 26935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:40.959192 26935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:40.959230 26935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:40.959259 26935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:19:40.960682 26935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.1.keytab
--principal=kudu/127.27.217.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:40127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:40.960899 26935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:40.961097 26935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:40.965574 26943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:40.965574 26948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:40.965601 26951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:40.965862 26935 server_base.cc:1034] running on GCE node
I20260809 16:19:40.966054 26935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:40.966274 26935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:40.967414 26935 hybrid_clock.cc:648] HybridClock initialized: now 1786292380967401 us; error 25 us; skew 500 ppm
Aug 09 16:19:40 dist-test-slave-nj21 krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292380, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:40.969795 26935 init.cc:377] Logged in from keytab as kudu/127.27.217.1@KRBTEST.COM (short username kudu)
I20260809 16:19:40.970204 26935 webserver.cc:460] Webserver started at http://127.27.217.1:34449/ using document root <none> and password file <none>
I20260809 16:19:40.970399 26935 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:40.970445 26935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:40.970572 26935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:40.971566 26935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "7db29d7c491c4a8785f380f306b0ba87"
format_stamp: "Formatted at 2026-08-09 16:19:40 on dist-test-slave-nj21"
server_key: "d6a6bcb4b52089bdf7df35c39c741493"
server_key_iv: "6a2e0f3ec531a0b2b3de2ce59de9cf5f"
server_key_version: "encryptionkey@0"
I20260809 16:19:40.971937 26935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "7db29d7c491c4a8785f380f306b0ba87"
format_stamp: "Formatted at 2026-08-09 16:19:40 on dist-test-slave-nj21"
server_key: "d6a6bcb4b52089bdf7df35c39c741493"
server_key_iv: "6a2e0f3ec531a0b2b3de2ce59de9cf5f"
server_key_version: "encryptionkey@0"
I20260809 16:19:40.973145 26935 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:19:40.973780 26959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:40.973908 26935 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:40.974002 26935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "7db29d7c491c4a8785f380f306b0ba87"
format_stamp: "Formatted at 2026-08-09 16:19:40 on dist-test-slave-nj21"
server_key: "d6a6bcb4b52089bdf7df35c39c741493"
server_key_iv: "6a2e0f3ec531a0b2b3de2ce59de9cf5f"
server_key_version: "encryptionkey@0"
I20260809 16:19:40.974061 26935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:40.987186 26935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:40.988860 26935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:40.989001 26935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:40.989217 26935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:40.989527 26935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:40.989562 26935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:40.989590 26935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:40.989609 26935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:40.995108 26935 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:38541
I20260809 16:19:40.995165 27125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:38541 every 8 connection(s)
I20260809 16:19:40.995430 26935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
Aug 09 16:19:40 dist-test-slave-nj21 krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292380, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.1@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:41.002980 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 26935
I20260809 16:19:41.003090 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:19:41.003294 28516 external_mini_cluster.cc:1428] Setting key fc8c969e9f0aa397ddf51fe9b65e3eb9
I20260809 16:19:41.003755 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:40.996072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:48845 (local address 127.27.217.62:40127)
0809 16:19:40.996147 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:40.996149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:40.996306 (+ 157us) server_negotiation.cc:407] Connection header received
0809 16:19:40.996821 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:40.996823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:40.996833 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:40.996888 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:40.997741 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:40.998240 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:40.999136 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:40.999325 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:40.999376 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.001243 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:41.001244 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:41.001244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:41.001251 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:41.002490 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:41.002783 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:41.002784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:41.002784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:41.002843 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:41.003045 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:41.003046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:41.003046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:41.003177 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:41.003247 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.003565 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.003642 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 16:19:41.003841 27130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:40.996048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:40127 (local address 127.27.217.1:48845)
0809 16:19:40.996199 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:40.996233 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:40.996733 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:40.996949 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:40.996952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:40.997492 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:40.997674 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:40.997679 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:40.998299 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:40.998300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:40.999083 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:40.999085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:40.999386 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:40.999387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:40.999485 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:40.999901 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:40.999909 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:41.001160 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:41.002547 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:41.002550 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:41.002551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:41.002731 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:41.002900 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:41.002901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:41.002901 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:41.002993 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:41.003239 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:41.003244 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:41.003362 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 16:19:41.003454 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 16:19:41.003598 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260809 16:19:41.004395 27126 heartbeater.cc:347] Connected to a master server at 127.27.217.62:40127
I20260809 16:19:41.004489 27126 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:41.004657 27126 heartbeater.cc:511] Master 127.27.217.62:40127 requested a full tablet report, sending...
I20260809 16:19:41.005133 26855 ts_manager.cc:194] Registered new tserver with Master: 7db29d7c491c4a8785f380f306b0ba87 (127.27.217.1:38541)
I20260809 16:19:41.005927 26855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.1@KRBTEST.COM'} at 127.27.217.1:48845
WARNING: no policy specified for kudu/127.27.217.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
Entry for principal kudu/127.27.217.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab.
I20260809 16:19:41.026059 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:40127
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:41.105811 27138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:41.106014 27138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:41.106036 27138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:41.107141 27138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:41.107178 27138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:41.107205 27138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:19:41.108656 27138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.2.keytab
--principal=kudu/127.27.217.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:40127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:41.108882 27138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:41.109090 27138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:41.113755 27148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:41.113744 27147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:41.113869 27138 server_base.cc:1034] running on GCE node
W20260809 16:19:41.113744 27150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:41.114140 27138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:41.114372 27138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:41.115520 27138 hybrid_clock.cc:648] HybridClock initialized: now 1786292381115509 us; error 28 us; skew 500 ppm
Aug 09 16:19:41 dist-test-slave-nj21 krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292381, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:41.117875 27138 init.cc:377] Logged in from keytab as kudu/127.27.217.2@KRBTEST.COM (short username kudu)
I20260809 16:19:41.118276 27138 webserver.cc:460] Webserver started at http://127.27.217.2:41483/ using document root <none> and password file <none>
I20260809 16:19:41.118491 27138 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:41.118537 27138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:41.118662 27138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:41.119722 27138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "43daa90957ee4993b6d81fb6e422a85b"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "ea84f2a64525e56a5b125b54ea657236"
server_key_iv: "7bd773fe657e6484a29b2ad2c17c1302"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.120074 27138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "43daa90957ee4993b6d81fb6e422a85b"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "ea84f2a64525e56a5b125b54ea657236"
server_key_iv: "7bd773fe657e6484a29b2ad2c17c1302"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.121335 27138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:19:41.122069 27166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:41.122260 27138 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:19:41.122344 27138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "43daa90957ee4993b6d81fb6e422a85b"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "ea84f2a64525e56a5b125b54ea657236"
server_key_iv: "7bd773fe657e6484a29b2ad2c17c1302"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.122408 27138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:41.132711 27138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:41.134436 27138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:41.134547 27138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:41.134713 27138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:41.134982 27138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:41.135013 27138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:41.135035 27138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:41.135051 27138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:41.140830 27138 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:44265
I20260809 16:19:41.140898 27334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:44265 every 8 connection(s)
I20260809 16:19:41.141182 27138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
Aug 09 16:19:41 dist-test-slave-nj21 krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292381, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.2@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:41.149593 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.141923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:43101 (local address 127.27.217.62:40127)
0809 16:19:41.141967 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.141969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.142170 (+ 201us) server_negotiation.cc:407] Connection header received
0809 16:19:41.142662 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.142664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.142677 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.142728 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:41.143768 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.144268 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.145221 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.145410 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.145465 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.147365 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:41.147367 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:41.147367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:41.147373 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:41.148553 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:41.148891 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:41.148892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:41.148892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:41.148947 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:41.149111 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:41.149112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:41.149112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:41.149205 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:41.149248 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.149458 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.149527 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:19:41.149732 27340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.141887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:40127 (local address 127.27.217.2:43101)
0809 16:19:41.142057 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:41.142093 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:41.142570 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:41.142791 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:41.142795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:41.143465 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:41.143662 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.143695 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.144348 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.144350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.145141 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.145144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.145480 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.145480 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.145601 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.146002 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:41.146009 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:41.147290 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:41.148619 (+ 1329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:41.148624 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:41.148626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:41.148828 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:41.148989 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:41.148989 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:41.148990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:41.149072 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:41.149244 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:41.149247 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:41.149355 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 16:19:41.149430 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 16:19:41.149558 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260809 16:19:41.150147 27335 heartbeater.cc:347] Connected to a master server at 127.27.217.62:40127
I20260809 16:19:41.150233 27335 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:41.150378 27335 heartbeater.cc:511] Master 127.27.217.62:40127 requested a full tablet report, sending...
I20260809 16:19:41.150566 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 27138
I20260809 16:19:41.150686 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:19:41.150792 26855 ts_manager.cc:194] Registered new tserver with Master: 43daa90957ee4993b6d81fb6e422a85b (127.27.217.2:44265)
I20260809 16:19:41.150875 28516 external_mini_cluster.cc:1428] Setting key c0aed88c6f0fcf407138717ec04f581c
I20260809 16:19:41.151217 26855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.2@KRBTEST.COM'} at 127.27.217.2:43101
WARNING: no policy specified for kudu/127.27.217.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
Entry for principal kudu/127.27.217.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab.
I20260809 16:19:41.174072 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:40127
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:41.253019 27345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:41.253213 27345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:41.253234 27345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:41.254316 27345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:41.254351 27345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:41.254375 27345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:19:41.255749 27345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.3.keytab
--principal=kudu/127.27.217.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:40127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:41.255935 27345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:41.256134 27345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:41.260671 27356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:41.260676 27359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:41.260905 27355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:41.260900 27345 server_base.cc:1034] running on GCE node
I20260809 16:19:41.261106 27345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:41.261333 27345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:41.262482 27345 hybrid_clock.cc:648] HybridClock initialized: now 1786292381262471 us; error 27 us; skew 500 ppm
Aug 09 16:19:41 dist-test-slave-nj21 krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292381, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:41.264910 27345 init.cc:377] Logged in from keytab as kudu/127.27.217.3@KRBTEST.COM (short username kudu)
I20260809 16:19:41.265275 27345 webserver.cc:460] Webserver started at http://127.27.217.3:40773/ using document root <none> and password file <none>
I20260809 16:19:41.265441 27345 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:41.265478 27345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:41.265568 27345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:41.266510 27345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "1e4c356a260a4382a2861f72176988c9"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "881a5b9ada52111e6f32bddf5077a8b8"
server_key_iv: "9e559e0aef0b0c002e17ac6ed55c0b60"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.266788 27345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "1e4c356a260a4382a2861f72176988c9"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "881a5b9ada52111e6f32bddf5077a8b8"
server_key_iv: "9e559e0aef0b0c002e17ac6ed55c0b60"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.267961 27345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:19:41.268672 27368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:41.268838 27345 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:41.268921 27345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "1e4c356a260a4382a2861f72176988c9"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "881a5b9ada52111e6f32bddf5077a8b8"
server_key_iv: "9e559e0aef0b0c002e17ac6ed55c0b60"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.268977 27345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:41.294661 27345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:41.296392 27345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:41.296509 27345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:41.296702 27345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:41.296942 27345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:41.296972 27345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:41.296993 27345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:41.297008 27345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:41.302516 27345 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:40193
I20260809 16:19:41.302560 27522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:40193 every 8 connection(s)
I20260809 16:19:41.302843 27345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
Aug 09 16:19:41 dist-test-slave-nj21 krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292381, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.3@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:19:41.308634 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 27345
I20260809 16:19:41.308751 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:19:41.308904 28516 external_mini_cluster.cc:1428] Setting key a23071b0f0783b34451897f57a5d8292
I20260809 16:19:41.311388 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.303473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:38337 (local address 127.27.217.62:40127)
0809 16:19:41.303513 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.303515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.303731 (+ 216us) server_negotiation.cc:407] Connection header received
0809 16:19:41.304227 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.304228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.304236 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.304291 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:41.305184 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.305699 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.306624 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.306795 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.306838 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.308811 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:41.308813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:41.308813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:41.308821 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:41.310178 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:41.310525 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:41.310526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:41.310527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:41.310582 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:41.310793 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:41.310794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:41.310794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:41.310905 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:41.310961 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.311211 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.311289 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:19:41.311527 27528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.303439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:40127 (local address 127.27.217.3:38337)
0809 16:19:41.303601 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:41.303642 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:41.304148 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:41.304363 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:41.304366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:41.304919 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:41.305110 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.305116 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.305780 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.305781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.306565 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.306567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.306848 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.306849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.306943 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.307321 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:19:41.307328 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:41.308717 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:41.310247 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:41.310253 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:41.310255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:41.310460 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:41.310633 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:19:41.310634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:19:41.310634 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:19:41.310738 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:19:41.310960 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:41.310966 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:41.311095 (+ 129us) client_negotiation.cc:769] Sending connection context
0809 16:19:41.311180 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 16:19:41.311326 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260809 16:19:41.311954 27525 heartbeater.cc:347] Connected to a master server at 127.27.217.62:40127
I20260809 16:19:41.312042 27525 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:41.312206 27525 heartbeater.cc:511] Master 127.27.217.62:40127 requested a full tablet report, sending...
I20260809 16:19:41.312510 26853 ts_manager.cc:194] Registered new tserver with Master: 1e4c356a260a4382a2861f72176988c9 (127.27.217.3:40193)
I20260809 16:19:41.312842 26853 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.217.3@KRBTEST.COM'} at 127.27.217.3:38337
I20260809 16:19:41.320568 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:19:41.327082 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.321874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42820 (local address 127.27.217.62:40127)
0809 16:19:41.321927 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.321928 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.322043 (+ 115us) server_negotiation.cc:407] Connection header received
0809 16:19:41.322102 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.322103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.322112 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.322158 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:41.322691 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.323149 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.323907 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.324120 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.324181 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.325206 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:41.325207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:41.325208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:41.325213 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:41.326264 (+ 1051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:41.326535 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:41.326536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:41.326536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:41.326579 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:41.326696 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:41.326696 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:41.326696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:41.326812 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:41.326877 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.326960 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.327013 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 16:19:41.328442 26853 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42820:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:19:41.329959 26853 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:19:41.336167 27540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.331863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40193 (local address 127.0.0.1:47628)
0809 16:19:41.332169 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:41.332209 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:41.332293 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:41.332667 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:41.332667 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:41.332669 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:41.332702 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.332704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.333960 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.333961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.335007 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.335009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.335921 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.335922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.335996 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.336000 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:41.336050 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 16:19:41.336093 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":25,"thread_start_us":48,"threads_started":1}
I20260809 16:19:41.336232 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.331925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47628 (local address 127.27.217.3:40193)
0809 16:19:41.332177 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.332182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.332269 (+ 87us) server_negotiation.cc:407] Connection header received
0809 16:19:41.332374 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.332377 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.332394 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.332484 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:41.332775 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.333856 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.335074 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.335783 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.335840 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.335888 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.336085 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.336161 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":92,"threads_started":1}
I20260809 16:19:41.336272 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.332134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60812 (local address 127.27.217.2:44265)
0809 16:19:41.332295 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.332299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.332431 (+ 132us) server_negotiation.cc:407] Connection header received
0809 16:19:41.332479 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.332481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.332495 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.332568 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:41.332798 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.333483 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.334897 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.335648 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.335744 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.335813 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.336147 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.336195 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260809 16:19:41.336921 27435 tablet_service.cc:1467] Processing CreateTablet for tablet a834a6fb10ca4e068d2662276ca0f1fc (DEFAULT_TABLE table=test-table [id=38222e72aee14fd8975f1b96bb7e836c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:41.337317 27435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a834a6fb10ca4e068d2662276ca0f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:41.337544 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.332016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45324 (local address 127.27.217.1:38541)
0809 16:19:41.332346 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.332350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.332360 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:19:41.332396 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.332398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.332412 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.332484 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:41.332728 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.333852 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.335782 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.337031 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.337112 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.337172 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.337422 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.337470 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":81,"threads_started":1}
I20260809 16:19:41.336436 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.332034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:44265 (local address 127.0.0.1:60812)
0809 16:19:41.332380 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:41.332388 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:41.332427 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:41.332631 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:41.332632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:41.332634 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:41.332684 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.332686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.333578 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.333580 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.334809 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.334812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.335791 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.335792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.335892 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.335908 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 16:19:41.335985 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 16:19:41.336039 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":80,"threads_started":1}
I20260809 16:19:41.339990 27549 tablet_bootstrap.cc:492] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Bootstrap starting.
I20260809 16:19:41.340045 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.331867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:38541 (local address 127.0.0.1:45324)
0809 16:19:41.332227 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:41.332235 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:41.332285 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:41.332575 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:41.332579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:41.332582 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:41.332643 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.332645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.333976 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.333977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.334813 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.334815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.337114 (+ 2299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.337115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.337179 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.337183 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:41.337381 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 16:19:41.337420 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":8,"thread_start_us":57,"threads_started":1}
I20260809 16:19:41.340605 27549 tablet_bootstrap.cc:654] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:41.340670 27029 tablet_service.cc:1467] Processing CreateTablet for tablet a834a6fb10ca4e068d2662276ca0f1fc (DEFAULT_TABLE table=test-table [id=38222e72aee14fd8975f1b96bb7e836c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:41.340672 27235 tablet_service.cc:1467] Processing CreateTablet for tablet a834a6fb10ca4e068d2662276ca0f1fc (DEFAULT_TABLE table=test-table [id=38222e72aee14fd8975f1b96bb7e836c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:41.340997 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a834a6fb10ca4e068d2662276ca0f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:41.340997 27235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a834a6fb10ca4e068d2662276ca0f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:41.341131 27549 log.cc:824] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:41.341801 27549 tablet_bootstrap.cc:492] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: No bootstrap required, opened a new log
I20260809 16:19:41.341861 27549 ts_tablet_manager.cc:1397] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:41.343307 27549 raft_consensus.cc:348] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.343457 27549 raft_consensus.cc:374] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:41.343492 27549 raft_consensus.cc:729] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e4c356a260a4382a2861f72176988c9, State: Initialized, Role: FOLLOWER
I20260809 16:19:41.343632 27549 consensus_queue.cc:260] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.343922 27525 heartbeater.cc:503] Master 127.27.217.62:40127 was elected leader, sending a full tablet report...
I20260809 16:19:41.344187 27555 tablet_bootstrap.cc:492] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Bootstrap starting.
I20260809 16:19:41.344635 27549 ts_tablet_manager.cc:1428] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 16:19:41.344867 27555 tablet_bootstrap.cc:654] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:41.345345 27555 log.cc:824] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:41.345607 27553 tablet_bootstrap.cc:492] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87: Bootstrap starting.
I20260809 16:19:41.345955 27555 tablet_bootstrap.cc:492] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: No bootstrap required, opened a new log
I20260809 16:19:41.346009 27555 ts_tablet_manager.cc:1397] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:41.346140 27553 tablet_bootstrap.cc:654] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:41.346587 27553 log.cc:824] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:41.347204 27553 tablet_bootstrap.cc:492] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87: No bootstrap required, opened a new log
I20260809 16:19:41.347272 27553 ts_tablet_manager.cc:1397] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:41.347462 27555 raft_consensus.cc:348] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.347606 27555 raft_consensus.cc:374] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:41.347626 27555 raft_consensus.cc:729] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43daa90957ee4993b6d81fb6e422a85b, State: Initialized, Role: FOLLOWER
I20260809 16:19:41.347754 27555 consensus_queue.cc:260] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.348001 27555 ts_tablet_manager.cc:1428] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:19:41.348034 27335 heartbeater.cc:503] Master 127.27.217.62:40127 was elected leader, sending a full tablet report...
I20260809 16:19:41.348958 27553 raft_consensus.cc:348] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.349090 27553 raft_consensus.cc:374] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:41.349123 27553 raft_consensus.cc:729] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7db29d7c491c4a8785f380f306b0ba87, State: Initialized, Role: FOLLOWER
I20260809 16:19:41.349225 27553 consensus_queue.cc:260] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.349478 27553 ts_tablet_manager.cc:1428] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 16:19:41.349495 27126 heartbeater.cc:503] Master 127.27.217.62:40127 was elected leader, sending a full tablet report...
W20260809 16:19:41.391777 27336 tablet.cc:2369] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:19:41.496187 27127 tablet.cc:2369] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:19:41.553373 27526 tablet.cc:2369] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:19:41.683336 27560 raft_consensus.cc:482] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:41.683460 27560 raft_consensus.cc:504] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.683877 27560 leader_election.cc:288] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e4c356a260a4382a2861f72176988c9 (127.27.217.3:40193), 43daa90957ee4993b6d81fb6e422a85b (127.27.217.2:44265)
I20260809 16:19:41.686646 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.684098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:49049 (local address 127.27.217.2:44265)
0809 16:19:41.684147 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.684149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.684264 (+ 115us) server_negotiation.cc:407] Connection header received
0809 16:19:41.684309 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.684310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.684319 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.684363 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:41.684524 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.684985 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.685992 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.686347 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.686400 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.686409 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.686547 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.686580 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 16:19:41.686674 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.684101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:51279 (local address 127.27.217.3:40193)
0809 16:19:41.684190 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.684192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.684223 (+ 31us) server_negotiation.cc:407] Connection header received
0809 16:19:41.684284 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.684285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.684295 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.684346 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:41.684505 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.684980 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.685985 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.686369 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.686445 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.686454 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.686574 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.686606 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 16:19:41.686702 27561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.684039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:44265 (local address 127.27.217.1:49049)
0809 16:19:41.684186 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:41.684196 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:41.684256 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:41.684367 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:41.684367 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:41.684369 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:41.684462 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.684464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.685055 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.685056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.685904 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.685906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.686417 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.686418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.686485 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.686489 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:41.686536 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 16:19:41.686575 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":46,"thread_start_us":86,"threads_started":1}
I20260809 16:19:41.686704 27565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.684024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:40193 (local address 127.27.217.1:51279)
0809 16:19:41.684170 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:41.684180 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:41.684233 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:41.684356 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:41.684357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:41.684359 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:41.684443 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.684446 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.685059 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.685060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.685901 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:41.685904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.686448 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.686449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:41.686511 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.686514 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:41.686564 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 16:19:41.686599 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":4,"thread_start_us":64,"threads_started":1}
I20260809 16:19:41.687033 27261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a834a6fb10ca4e068d2662276ca0f1fc" candidate_uuid: "7db29d7c491c4a8785f380f306b0ba87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43daa90957ee4993b6d81fb6e422a85b" is_pre_election: true
I20260809 16:19:41.687033 27463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a834a6fb10ca4e068d2662276ca0f1fc" candidate_uuid: "7db29d7c491c4a8785f380f306b0ba87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e4c356a260a4382a2861f72176988c9" is_pre_election: true
I20260809 16:19:41.687177 27463 raft_consensus.cc:2454] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7db29d7c491c4a8785f380f306b0ba87 in term 0.
I20260809 16:19:41.687180 27261 raft_consensus.cc:2454] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7db29d7c491c4a8785f380f306b0ba87 in term 0.
I20260809 16:19:41.687389 26965 leader_election.cc:302] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e4c356a260a4382a2861f72176988c9, 7db29d7c491c4a8785f380f306b0ba87; no voters:
I20260809 16:19:41.687549 27560 raft_consensus.cc:2781] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:19:41.687604 27560 raft_consensus.cc:482] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:19:41.687624 27560 raft_consensus.cc:3037] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:41.688376 27560 raft_consensus.cc:504] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.688555 27560 leader_election.cc:288] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [CANDIDATE]: Term 1 election: Requested vote from peers 1e4c356a260a4382a2861f72176988c9 (127.27.217.3:40193), 43daa90957ee4993b6d81fb6e422a85b (127.27.217.2:44265)
I20260809 16:19:41.688625 27261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a834a6fb10ca4e068d2662276ca0f1fc" candidate_uuid: "7db29d7c491c4a8785f380f306b0ba87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43daa90957ee4993b6d81fb6e422a85b"
I20260809 16:19:41.688632 27463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a834a6fb10ca4e068d2662276ca0f1fc" candidate_uuid: "7db29d7c491c4a8785f380f306b0ba87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e4c356a260a4382a2861f72176988c9"
I20260809 16:19:41.688690 27261 raft_consensus.cc:3037] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:41.688704 27463 raft_consensus.cc:3037] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:41.689365 27261 raft_consensus.cc:2454] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7db29d7c491c4a8785f380f306b0ba87 in term 1.
I20260809 16:19:41.689378 27463 raft_consensus.cc:2454] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7db29d7c491c4a8785f380f306b0ba87 in term 1.
I20260809 16:19:41.689558 26964 leader_election.cc:302] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43daa90957ee4993b6d81fb6e422a85b, 7db29d7c491c4a8785f380f306b0ba87; no voters:
I20260809 16:19:41.689658 27560 raft_consensus.cc:2781] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:41.689783 27560 raft_consensus.cc:686] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [term 1 LEADER]: Becoming Leader. State: Replica: 7db29d7c491c4a8785f380f306b0ba87, State: Running, Role: LEADER
I20260809 16:19:41.689877 27560 consensus_queue.cc:237] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } }
I20260809 16:19:41.690719 26853 catalog_manager.cc:5495] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7db29d7c491c4a8785f380f306b0ba87 (127.27.217.1). New cstate: current_term: 1 leader_uuid: "7db29d7c491c4a8785f380f306b0ba87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7db29d7c491c4a8785f380f306b0ba87" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260809 16:19:41.772866 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.770643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45332 (local address 127.27.217.1:38541)
0809 16:19:41.770695 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.770697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.770705 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:41.770741 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.770742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.770759 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.770815 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:19:41.770918 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.771424 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.772222 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.772423 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.772473 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.772576 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:19:41.772675 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:19:41.772753 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.772769 (+ 16us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.772787 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:19:41.774562 27463 raft_consensus.cc:1261] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 1 FOLLOWER]: Refusing update from remote peer 7db29d7c491c4a8785f380f306b0ba87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:41.774577 27261 raft_consensus.cc:1261] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 1 FOLLOWER]: Refusing update from remote peer 7db29d7c491c4a8785f380f306b0ba87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:41.774907 27566 consensus_queue.cc:1035] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e4c356a260a4382a2861f72176988c9" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 40193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:41.775033 27560 consensus_queue.cc:1035] T a834a6fb10ca4e068d2662276ca0f1fc P 7db29d7c491c4a8785f380f306b0ba87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43daa90957ee4993b6d81fb6e422a85b" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:41.777544 27570 mvcc.cc:205] Tried to move back new op lower bound from 7316653595745996800 to 7316653595402358784. Current Snapshot: MvccSnapshot[applied={T|T < 7316653595745996800}]
I20260809 16:19:41.779824 26853 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:41.779907 26853 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:41.780612 26853 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3b5689ca86b4cd1826d0713b5ecc7b6: Sending DeleteTablet for 3 replicas of tablet a834a6fb10ca4e068d2662276ca0f1fc
I20260809 16:19:41.780947 27235 tablet_service.cc:1514] Processing DeleteTablet for tablet a834a6fb10ca4e068d2662276ca0f1fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:41 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:60812
I20260809 16:19:41.780972 27029 tablet_service.cc:1514] Processing DeleteTablet for tablet a834a6fb10ca4e068d2662276ca0f1fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:41 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:45324
I20260809 16:19:41.780956 27435 tablet_service.cc:1514] Processing DeleteTablet for tablet a834a6fb10ca4e068d2662276ca0f1fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:41 UTC) from {username='kudu', principal='kudu/127.27.217.62@KRBTEST.COM'} at 127.0.0.1:47628
I20260809 16:19:41.781186 27581 tablet_replica.cc:330] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: stopping tablet replica
I20260809 16:19:41.781286 27581 raft_consensus.cc:2229] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:41.781405 27581 raft_consensus.cc:2258] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:41.781442 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 26935
I20260809 16:19:41.781821 27581 ts_tablet_manager.cc:1905] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:41.783615 27581 ts_tablet_manager.cc:1918] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:41.783738 27581 log.cc:1196] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/a834a6fb10ca4e068d2662276ca0f1fc
I20260809 16:19:41.784026 27581 ts_tablet_manager.cc:1939] T a834a6fb10ca4e068d2662276ca0f1fc P 43daa90957ee4993b6d81fb6e422a85b: Deleting consensus metadata
I20260809 16:19:41.784478 26837 catalog_manager.cc:4841] TS 43daa90957ee4993b6d81fb6e422a85b (127.27.217.2:44265): tablet a834a6fb10ca4e068d2662276ca0f1fc (table test-table [id=38222e72aee14fd8975f1b96bb7e836c]) successfully deleted
I20260809 16:19:41.781229 27585 tablet_replica.cc:330] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: stopping tablet replica
I20260809 16:19:41.788710 27585 raft_consensus.cc:2229] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:41.788828 27585 raft_consensus.cc:2258] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:41.790202 27585 ts_tablet_manager.cc:1905] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:41.791772 27585 ts_tablet_manager.cc:1918] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:41.791847 27585 log.cc:1196] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/a834a6fb10ca4e068d2662276ca0f1fc
I20260809 16:19:41.792074 27585 ts_tablet_manager.cc:1939] T a834a6fb10ca4e068d2662276ca0f1fc P 1e4c356a260a4382a2861f72176988c9: Deleting consensus metadata
I20260809 16:19:41.792484 26839 catalog_manager.cc:4841] TS 1e4c356a260a4382a2861f72176988c9 (127.27.217.3:40193): tablet a834a6fb10ca4e068d2662276ca0f1fc (table test-table [id=38222e72aee14fd8975f1b96bb7e836c]) successfully deleted
W20260809 16:19:41.794081 26837 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:38541 (error 108)
I20260809 16:19:41.794535 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 27138
I20260809 16:19:41.794545 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.794399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:38541 (local address 127.0.0.1:45338)
0809 16:19:41.794467 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:41.794510 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:38541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 16:19:41.796059 26837 catalog_manager.cc:4584] TS 7db29d7c491c4a8785f380f306b0ba87 (127.27.217.1:38541): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a834a6fb10ca4e068d2662276ca0f1fc: Network error: Client connection negotiation failed: client connection to 127.27.217.1:38541: connect: Connection refused (error 111)
I20260809 16:19:41.805256 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 27345
I20260809 16:19:41.817049 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 26807
2026-08-09T16:19:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2381 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T16:19:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:41Z Disabled control of system clock
I20260809 16:19:41.846413 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35699
--webserver_interface=127.27.217.62
--webserver_port=0
--builtin_ntp_servers=127.27.217.20:38577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:35699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:41.925890 27592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:41.926093 27592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:41.926121 27592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:41.927206 27592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:41.927245 27592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:41.927263 27592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:41.927278 27592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:41.927294 27592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:41.928610 27592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:35699
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:41.928849 27592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:41.929101 27592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:41.933759 27603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:41.933801 27600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:41.933764 27599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:41.933976 27592 server_base.cc:1034] running on GCE node
I20260809 16:19:41.934231 27592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:41.934485 27592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:41.935636 27592 hybrid_clock.cc:648] HybridClock initialized: now 1786292381935620 us; error 33 us; skew 500 ppm
I20260809 16:19:41.936866 27592 webserver.cc:460] Webserver started at http://127.27.217.62:45131/ using document root <none> and password file <none>
I20260809 16:19:41.937072 27592 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:41.937116 27592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:41.937242 27592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:41.938287 27592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "23b555533f5a4f5cbe46d0a3a1093ebd"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "ae26db5f6e30927a6864d06aaba4965a"
server_key_iv: "45d308129cc1811e69cf353c9dd48d34"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.938609 27592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "23b555533f5a4f5cbe46d0a3a1093ebd"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "ae26db5f6e30927a6864d06aaba4965a"
server_key_iv: "45d308129cc1811e69cf353c9dd48d34"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.939859 27592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:41.940502 27611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:41.940670 27592 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:41.940768 27592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "23b555533f5a4f5cbe46d0a3a1093ebd"
format_stamp: "Formatted at 2026-08-09 16:19:41 on dist-test-slave-nj21"
server_key: "ae26db5f6e30927a6864d06aaba4965a"
server_key_iv: "45d308129cc1811e69cf353c9dd48d34"
server_key_version: "encryptionkey@0"
I20260809 16:19:41.940825 27592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:41.951725 27592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:41.951978 27592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:41.952098 27592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:41.955696 27592 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:35699
I20260809 16:19:41.955739 27689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:35699 every 8 connection(s)
I20260809 16:19:41.956041 27592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:41.956933 27690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:41.959065 27690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd: Bootstrap starting.
I20260809 16:19:41.959589 27690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:41.959888 27690 log.cc:824] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:41.960223 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 27592
I20260809 16:19:41.960318 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:41.960497 28516 external_mini_cluster.cc:1428] Setting key 840cf175441ab850424efa40818ebc70
I20260809 16:19:41.960565 27690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd: No bootstrap required, opened a new log
I20260809 16:19:41.963503 27690 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b555533f5a4f5cbe46d0a3a1093ebd" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35699 } }
I20260809 16:19:41.963657 27690 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:41.963724 27690 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23b555533f5a4f5cbe46d0a3a1093ebd, State: Initialized, Role: FOLLOWER
I20260809 16:19:41.963850 27690 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b555533f5a4f5cbe46d0a3a1093ebd" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35699 } }
I20260809 16:19:41.963933 27690 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:41.963963 27690 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:41.964010 27690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:41.964514 27690 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b555533f5a4f5cbe46d0a3a1093ebd" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35699 } }
I20260809 16:19:41.964620 27690 leader_election.cc:302] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23b555533f5a4f5cbe46d0a3a1093ebd; no voters:
I20260809 16:19:41.964766 27690 leader_election.cc:288] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:41.964809 27698 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:41.964958 27698 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [term 1 LEADER]: Becoming Leader. State: Replica: 23b555533f5a4f5cbe46d0a3a1093ebd, State: Running, Role: LEADER
I20260809 16:19:41.964999 27690 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:41.965055 27698 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b555533f5a4f5cbe46d0a3a1093ebd" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35699 } }
I20260809 16:19:41.965408 27699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23b555533f5a4f5cbe46d0a3a1093ebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b555533f5a4f5cbe46d0a3a1093ebd" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35699 } } }
I20260809 16:19:41.965492 27699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:41.965413 27700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23b555533f5a4f5cbe46d0a3a1093ebd. Latest consensus state: current_term: 1 leader_uuid: "23b555533f5a4f5cbe46d0a3a1093ebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23b555533f5a4f5cbe46d0a3a1093ebd" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35699 } } }
I20260809 16:19:41.965649 27700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:41.966384 27706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:41.966804 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:41.960921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55702 (local address 127.27.217.62:35699)
0809 16:19:41.961139 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:41.961147 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:41.961178 (+ 31us) server_negotiation.cc:407] Connection header received
0809 16:19:41.962008 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:41.962018 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:41.962103 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:41.962250 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:41.962396 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.963744 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.964559 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:41.965153 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:41.965608 (+ 455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:41.965948 (+ 340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:41.965952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:41.965953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:41.966169 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:41.966220 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:41.966234 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:41.966545 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:41.966585 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 16:19:41.966647 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
I20260809 16:19:41.966825 27706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:41.968390 27706 catalog_manager.cc:1347] Generated new cluster ID: 70755ede91224716ba1526008d64f723
I20260809 16:19:41.968437 27706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:41.981019 27706 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:41.981463 27706 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:41.985610 27706 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd: Generated new TSK 0
I20260809 16:19:41.985740 27706 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:41.988339 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.1:0
--local_ip_for_outbound_sockets=127.27.217.1
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35699
--builtin_ntp_servers=127.27.217.20:38577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:42.068040 27721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:42.068233 27721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:42.068253 27721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:42.069360 27721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:42.069401 27721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:42.069422 27721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.1
I20260809 16:19:42.070744 27721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.217.1
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.1
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:42.070955 27721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:42.071233 27721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:19:42.075971 27721 server_base.cc:1034] running on GCE node
W20260809 16:19:42.075951 27735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:42.076097 27739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:42.076200 27736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:42.076386 27721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:42.076617 27721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:42.077764 27721 hybrid_clock.cc:648] HybridClock initialized: now 1786292382077754 us; error 30 us; skew 500 ppm
I20260809 16:19:42.078939 27721 webserver.cc:460] Webserver started at http://127.27.217.1:35765/ using document root <none> and password file <none>
I20260809 16:19:42.079147 27721 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:42.079193 27721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:42.079319 27721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:42.080350 27721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/data/instance:
uuid: "d2cd4555b38d416aa75d9893434ef4ea"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "8553e39042979cab096627c20117642a"
server_key_iv: "72a5269b9ffa35b6971a9cb20ee5f790"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.080677 27721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance:
uuid: "d2cd4555b38d416aa75d9893434ef4ea"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "8553e39042979cab096627c20117642a"
server_key_iv: "72a5269b9ffa35b6971a9cb20ee5f790"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.081965 27721 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:19:42.082674 27748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.082829 27721 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:42.082916 27721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/wal
uuid: "d2cd4555b38d416aa75d9893434ef4ea"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "8553e39042979cab096627c20117642a"
server_key_iv: "72a5269b9ffa35b6971a9cb20ee5f790"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.083002 27721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:42.100445 27721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:42.100732 27721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:42.100862 27721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:42.101087 27721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:42.101426 27721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:42.101470 27721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.101504 27721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:42.101527 27721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.107021 27721 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.1:38611
I20260809 16:19:42.107092 27922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.1:38611 every 8 connection(s)
I20260809 16:19:42.107366 27721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/data/info.pb
I20260809 16:19:42.111958 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.108049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.1:33135 (local address 127.27.217.62:35699)
0809 16:19:42.108111 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.108114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.108326 (+ 212us) server_negotiation.cc:407] Connection header received
0809 16:19:42.108790 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.108792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.108806 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.108856 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:42.109477 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.109960 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.110853 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.111025 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.111065 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.111754 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:42.111756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:42.111756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:42.111761 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:42.111776 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:42.111780 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:42.111816 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.111876 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.111899 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 16:19:42.112142 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.108028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35699 (local address 127.27.217.1:33135)
0809 16:19:42.108219 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.108253 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:42.108718 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:42.108910 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:42.108913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:42.108921 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:42.109396 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.109400 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.110027 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.110028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.110791 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.110794 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.111078 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.111079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.111177 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.111596 (+ 419us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:42.111597 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:42.111623 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:42.111644 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:42.111819 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:42.111822 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:42.111825 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:42.111871 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 16:19:42.111946 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260809 16:19:42.112596 27923 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35699
I20260809 16:19:42.112674 27923 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:42.112813 27923 heartbeater.cc:511] Master 127.27.217.62:35699 requested a full tablet report, sending...
I20260809 16:19:42.113268 27636 ts_manager.cc:194] Registered new tserver with Master: d2cd4555b38d416aa75d9893434ef4ea (127.27.217.1:38611)
I20260809 16:19:42.113478 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 27721
I20260809 16:19:42.113571 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-0/wal/instance
I20260809 16:19:42.113771 28516 external_mini_cluster.cc:1428] Setting key af79c9ba68bdb681234c0de82b3d4e00
I20260809 16:19:42.113955 27636 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.1:33135
I20260809 16:19:42.114770 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.2:0
--local_ip_for_outbound_sockets=127.27.217.2
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35699
--builtin_ntp_servers=127.27.217.20:38577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:42.193763 27926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:42.193953 27926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:42.193984 27926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:42.195076 27926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:42.195113 27926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:42.195144 27926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.2
I20260809 16:19:42.196504 27926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.217.2
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.2
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:42.196730 27926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:42.196990 27926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:42.201661 27935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:42.201794 27936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:42.201898 27926 server_base.cc:1034] running on GCE node
W20260809 16:19:42.201673 27941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:42.202143 27926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:42.202383 27926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:42.203539 27926 hybrid_clock.cc:648] HybridClock initialized: now 1786292382203516 us; error 34 us; skew 500 ppm
I20260809 16:19:42.204743 27926 webserver.cc:460] Webserver started at http://127.27.217.2:36989/ using document root <none> and password file <none>
I20260809 16:19:42.204969 27926 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:42.205029 27926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:42.205161 27926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:42.206365 27926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/data/instance:
uuid: "4dc534f99d744d0ea5efb98ac3869d25"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "44e6f290df3fe8ab45f5f298cceb2426"
server_key_iv: "17d32cb0a03d5149df2a8ce2d70e86c1"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.206691 27926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance:
uuid: "4dc534f99d744d0ea5efb98ac3869d25"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "44e6f290df3fe8ab45f5f298cceb2426"
server_key_iv: "17d32cb0a03d5149df2a8ce2d70e86c1"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.207960 27926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:42.208580 27948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.208726 27926 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:42.208808 27926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/wal
uuid: "4dc534f99d744d0ea5efb98ac3869d25"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "44e6f290df3fe8ab45f5f298cceb2426"
server_key_iv: "17d32cb0a03d5149df2a8ce2d70e86c1"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.208873 27926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:42.227090 27926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:42.227346 27926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:42.227471 27926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:42.227664 27926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:42.227996 27926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:42.228030 27926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.228057 27926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:42.228075 27926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.233455 27926 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.2:36753
I20260809 16:19:42.233490 28120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.2:36753 every 8 connection(s)
I20260809 16:19:42.233784 27926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/data/info.pb
I20260809 16:19:42.238317 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.234441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:45097 (local address 127.27.217.62:35699)
0809 16:19:42.234486 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.234488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.234691 (+ 203us) server_negotiation.cc:407] Connection header received
0809 16:19:42.235127 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.235128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.235139 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.235183 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:42.235829 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.236317 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.237208 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.237394 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.237445 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.238136 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:42.238136 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:42.238137 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:42.238140 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:42.238150 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:42.238154 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:42.238187 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.238239 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.238259 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 16:19:42.238482 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.234403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35699 (local address 127.27.217.2:45097)
0809 16:19:42.234585 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.234615 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:42.235055 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:42.235238 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:42.235241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:42.235249 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:42.235765 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.235770 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.236376 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.236376 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.237142 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.237144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.237450 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.237450 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.237546 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.238026 (+ 480us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:42.238027 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:42.238053 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:42.238074 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:42.238189 (+ 115us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:42.238191 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:42.238193 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 16:19:42.238236 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:19:42.238306 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":104,"threads_started":1}
I20260809 16:19:42.238924 28121 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35699
I20260809 16:19:42.238999 28121 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:42.239131 28121 heartbeater.cc:511] Master 127.27.217.62:35699 requested a full tablet report, sending...
I20260809 16:19:42.239441 27635 ts_manager.cc:194] Registered new tserver with Master: 4dc534f99d744d0ea5efb98ac3869d25 (127.27.217.2:36753)
I20260809 16:19:42.239491 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 27926
I20260809 16:19:42.239600 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/wal/instance
I20260809 16:19:42.239812 28516 external_mini_cluster.cc:1428] Setting key 6eccd8baf515c2816fdfd8b2e6c10e0c
I20260809 16:19:42.239876 27635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.2:45097
I20260809 16:19:42.240640 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.217.3:0
--local_ip_for_outbound_sockets=127.27.217.3
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35699
--builtin_ntp_servers=127.27.217.20:38577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 16:19:42.319583 28126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:42.319790 28126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:42.319810 28126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:42.320878 28126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:42.320909 28126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:42.320932 28126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.217.3
I20260809 16:19:42.322165 28126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:38577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.217.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.217.3
--webserver_port=0
--tserver_master_addrs=127.27.217.62:35699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.217.3
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:42.322332 28126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:42.322568 28126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:42.327173 28134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:42.327220 28138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:42.327227 28132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:42.327257 28126 server_base.cc:1034] running on GCE node
I20260809 16:19:42.327602 28126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:42.327864 28126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:42.328997 28126 hybrid_clock.cc:648] HybridClock initialized: now 1786292382328983 us; error 32 us; skew 500 ppm
I20260809 16:19:42.330150 28126 webserver.cc:460] Webserver started at http://127.27.217.3:37125/ using document root <none> and password file <none>
I20260809 16:19:42.330354 28126 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:42.330411 28126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:42.330533 28126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:42.331529 28126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/data/instance:
uuid: "4530a34cc756426ab51d095a153196e8"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "672e9d3055dbfc732e69684ff7e11b01"
server_key_iv: "7be5900c2780fe60423a81bed7519290"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.331877 28126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance:
uuid: "4530a34cc756426ab51d095a153196e8"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "672e9d3055dbfc732e69684ff7e11b01"
server_key_iv: "7be5900c2780fe60423a81bed7519290"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.333048 28126 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:19:42.333668 28146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.333817 28126 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:42.333900 28126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/wal
uuid: "4530a34cc756426ab51d095a153196e8"
format_stamp: "Formatted at 2026-08-09 16:19:42 on dist-test-slave-nj21"
server_key: "672e9d3055dbfc732e69684ff7e11b01"
server_key_iv: "7be5900c2780fe60423a81bed7519290"
server_key_version: "encryptionkey@0"
I20260809 16:19:42.333964 28126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:42.345479 28126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:42.345746 28126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:42.345868 28126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:42.346089 28126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 16:19:42.346400 28126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 16:19:42.346434 28126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.346462 28126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 16:19:42.346479 28126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:42.351891 28126 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.3:39497
I20260809 16:19:42.351953 28309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.3:39497 every 8 connection(s)
I20260809 16:19:42.352240 28126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/data/info.pb
I20260809 16:19:42.355710 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 28126
I20260809 16:19:42.355829 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/wal/instance
I20260809 16:19:42.356033 28516 external_mini_cluster.cc:1428] Setting key 4d04b71a7ff1d65904434265ddcb312b
I20260809 16:19:42.357103 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.352948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.3:52841 (local address 127.27.217.62:35699)
0809 16:19:42.353011 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.353013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.353192 (+ 179us) server_negotiation.cc:407] Connection header received
0809 16:19:42.353650 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.353651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.353660 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.353714 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:42.354327 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.354806 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.355719 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.355976 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.356034 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.356866 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:42.356868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:42.356868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:42.356873 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:42.356891 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:42.356896 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:42.356946 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.357022 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.357044 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 16:19:42.357285 28314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.352902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:35699 (local address 127.27.217.3:52841)
0809 16:19:42.353076 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.353115 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:42.353578 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:42.353773 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:42.353777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:42.353785 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:19:42.354269 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.354273 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.354865 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.354866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.355620 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.355622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.356047 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.356048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.356191 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.356729 (+ 538us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 16:19:42.356729 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:19:42.356757 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 16:19:42.356784 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:19:42.356954 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:19:42.356958 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:19:42.356961 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:42.357018 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 16:19:42.357095 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
I20260809 16:19:42.357698 28311 heartbeater.cc:347] Connected to a master server at 127.27.217.62:35699
I20260809 16:19:42.357820 28311 heartbeater.cc:464] Registering TS with master...
I20260809 16:19:42.357999 28311 heartbeater.cc:511] Master 127.27.217.62:35699 requested a full tablet report, sending...
I20260809 16:19:42.358335 27635 ts_manager.cc:194] Registered new tserver with Master: 4530a34cc756426ab51d095a153196e8 (127.27.217.3:39497)
I20260809 16:19:42.358682 27635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.217.3:52841
I20260809 16:19:42.367568 28516 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 16:19:42.371497 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.369054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55710 (local address 127.27.217.62:35699)
0809 16:19:42.369126 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.369127 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.369194 (+ 67us) server_negotiation.cc:407] Connection header received
0809 16:19:42.369244 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.369245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.369260 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.369300 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:42.369466 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.369919 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.370598 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.370768 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.370807 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.371340 (+ 533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:42.371341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:42.371341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:42.371345 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:42.371353 (+ 8us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:42.371356 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:42.371384 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.371420 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.371443 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 16:19:42.372836 27635 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 16:19:42.374315 27635 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 16:19:42.380079 28323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.376279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:39497 (local address 127.0.0.1:38346)
0809 16:19:42.376453 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.376491 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:42.376553 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:42.376951 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:42.376952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:42.376954 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:42.376987 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.376988 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.377887 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.377888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.379012 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.379015 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.379804 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.379805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.379879 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.379891 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 16:19:42.379953 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 16:19:42.380004 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":65,"threads_started":1}
I20260809 16:19:42.380095 28329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.376621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38346 (local address 127.27.217.3:39497)
0809 16:19:42.376795 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.376798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.376806 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:42.376837 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.376839 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.376855 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.377051 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:42.377107 (+ 56us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.377807 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.379104 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.379738 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.379798 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.379889 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.379977 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.380017 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260809 16:19:42.380420 28325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.376279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.2:36753 (local address 127.0.0.1:57420)
0809 16:19:42.376645 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.376652 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:42.376685 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:42.377033 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:42.377034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:42.377037 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:42.377084 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.377085 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.378313 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.378314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.379185 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.379187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.380180 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.380182 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.380245 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.380249 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:42.380300 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 16:19:42.380336 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":4,"thread_start_us":89,"threads_started":1}
I20260809 16:19:42.380455 28327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.376461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57420 (local address 127.27.217.2:36753)
0809 16:19:42.376828 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.376833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.376851 (+ 18us) server_negotiation.cc:407] Connection header received
0809 16:19:42.376886 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.376888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.376902 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.376970 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:42.377157 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.378233 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.379257 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.379994 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.380061 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.380142 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.380322 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.380366 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":76,"threads_started":1}
I20260809 16:19:42.380746 28215 tablet_service.cc:1467] Processing CreateTablet for tablet 2f2745a516274dc08946762725f6214c (DEFAULT_TABLE table=test-table [id=2b97ad5fb5a949f7885e8a31c1ebc938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:42.380957 28326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.376282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:38611 (local address 127.0.0.1:54286)
0809 16:19:42.376453 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.376491 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:42.376553 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:42.376858 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:42.376861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:42.376863 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:42.376939 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.376941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.378293 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.378294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.379346 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.379349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.380732 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.380734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.380795 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.380799 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:42.380859 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 16:19:42.380895 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":26,"thread_start_us":103,"threads_started":1}
I20260809 16:19:42.380973 28328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.376522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54286 (local address 127.27.217.1:38611)
0809 16:19:42.376691 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.376695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.376705 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:19:42.376744 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.376746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.376762 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.376851 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:42.377073 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.378204 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.379427 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.380429 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.380708 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.380774 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.380866 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.380896 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":70,"threads_started":1}
I20260809 16:19:42.381160 28215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f2745a516274dc08946762725f6214c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:42.381537 27817 tablet_service.cc:1467] Processing CreateTablet for tablet 2f2745a516274dc08946762725f6214c (DEFAULT_TABLE table=test-table [id=2b97ad5fb5a949f7885e8a31c1ebc938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:42.381830 27817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f2745a516274dc08946762725f6214c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:42.383791 28333 tablet_bootstrap.cc:492] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Bootstrap starting.
I20260809 16:19:42.384409 28334 tablet_bootstrap.cc:492] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea: Bootstrap starting.
I20260809 16:19:42.384325 28025 tablet_service.cc:1467] Processing CreateTablet for tablet 2f2745a516274dc08946762725f6214c (DEFAULT_TABLE table=test-table [id=2b97ad5fb5a949f7885e8a31c1ebc938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 16:19:42.384614 28333 tablet_bootstrap.cc:654] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:42.384658 28025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f2745a516274dc08946762725f6214c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:42.384938 28333 log.cc:824] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:42.385052 28334 tablet_bootstrap.cc:654] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:42.385330 28334 log.cc:824] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:42.385687 28333 tablet_bootstrap.cc:492] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: No bootstrap required, opened a new log
I20260809 16:19:42.385756 28333 ts_tablet_manager.cc:1397] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:42.386152 28334 tablet_bootstrap.cc:492] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea: No bootstrap required, opened a new log
I20260809 16:19:42.386221 28334 ts_tablet_manager.cc:1397] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:42.387704 28337 tablet_bootstrap.cc:492] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Bootstrap starting.
I20260809 16:19:42.388209 28337 tablet_bootstrap.cc:654] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:42.388247 28333 raft_consensus.cc:348] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.388427 28333 raft_consensus.cc:374] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:42.388475 28333 raft_consensus.cc:729] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4530a34cc756426ab51d095a153196e8, State: Initialized, Role: FOLLOWER
I20260809 16:19:42.388510 28337 log.cc:824] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:42.388592 28333 consensus_queue.cc:260] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.388603 28334 raft_consensus.cc:348] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.388743 28334 raft_consensus.cc:374] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:42.388785 28334 raft_consensus.cc:729] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cd4555b38d416aa75d9893434ef4ea, State: Initialized, Role: FOLLOWER
I20260809 16:19:42.388852 28333 ts_tablet_manager.cc:1428] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:19:42.388911 28334 consensus_queue.cc:260] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.388978 28311 heartbeater.cc:503] Master 127.27.217.62:35699 was elected leader, sending a full tablet report...
I20260809 16:19:42.389160 28334 ts_tablet_manager.cc:1428] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 16:19:42.389196 27923 heartbeater.cc:503] Master 127.27.217.62:35699 was elected leader, sending a full tablet report...
I20260809 16:19:42.389832 28337 tablet_bootstrap.cc:492] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: No bootstrap required, opened a new log
I20260809 16:19:42.389894 28337 ts_tablet_manager.cc:1397] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 16:19:42.391747 28337 raft_consensus.cc:348] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.391899 28337 raft_consensus.cc:374] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:42.391943 28337 raft_consensus.cc:729] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc534f99d744d0ea5efb98ac3869d25, State: Initialized, Role: FOLLOWER
I20260809 16:19:42.392046 28337 consensus_queue.cc:260] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.392264 28337 ts_tablet_manager.cc:1428] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 16:19:42.392313 28121 heartbeater.cc:503] Master 127.27.217.62:35699 was elected leader, sending a full tablet report...
W20260809 16:19:42.484295 28122 tablet.cc:2369] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:19:42.602766 28313 tablet.cc:2369] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 16:19:42.608016 27924 tablet.cc:2369] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 16:19:42.654922 28343 raft_consensus.cc:482] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 16:19:42.655053 28343 raft_consensus.cc:504] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.655445 28343 leader_election.cc:288] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4530a34cc756426ab51d095a153196e8 (127.27.217.3:39497), d2cd4555b38d416aa75d9893434ef4ea (127.27.217.1:38611)
I20260809 16:19:42.659092 28329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.655734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:34677 (local address 127.27.217.3:39497)
0809 16:19:42.655948 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.655951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.655959 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:42.655987 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.655988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.656012 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.656063 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:42.656262 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.656980 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.658196 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.658738 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.658811 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.658820 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.658981 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.659019 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260809 16:19:42.659092 28328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.655742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.217.2:48737 (local address 127.27.217.1:38611)
0809 16:19:42.655787 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.655789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.655801 (+ 12us) server_negotiation.cc:407] Connection header received
0809 16:19:42.655833 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.655833 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.655845 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.655912 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 16:19:42.656116 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.656873 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.658200 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.658738 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.658811 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.658820 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.658981 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.659020 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:19:42.659106 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.655635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:38611 (local address 127.27.217.2:48737)
0809 16:19:42.655716 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.655727 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:42.655774 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:42.655944 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:42.655945 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:42.655946 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:42.656027 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.656029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.656943 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.656944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.658115 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.658118 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.658818 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.658819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.658909 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.658913 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 16:19:42.658968 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 16:19:42.659014 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":5}
I20260809 16:19:42.659111 28345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.655640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.3:39497 (local address 127.27.217.2:34677)
0809 16:19:42.655828 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.655837 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:19:42.655877 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:19:42.656073 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:19:42.656074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:19:42.656076 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 16:19:42.656199 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.656202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.657046 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.657047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.658126 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:19:42.658127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.658819 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.658820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:19:42.658910 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.658913 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 16:19:42.658968 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 16:19:42.659011 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":17,"thread_start_us":115,"threads_started":1}
I20260809 16:19:42.659446 27852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f2745a516274dc08946762725f6214c" candidate_uuid: "4dc534f99d744d0ea5efb98ac3869d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cd4555b38d416aa75d9893434ef4ea" is_pre_election: true
I20260809 16:19:42.659621 27852 raft_consensus.cc:2454] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dc534f99d744d0ea5efb98ac3869d25 in term 0.
I20260809 16:19:42.659735 28247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f2745a516274dc08946762725f6214c" candidate_uuid: "4dc534f99d744d0ea5efb98ac3869d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4530a34cc756426ab51d095a153196e8" is_pre_election: true
I20260809 16:19:42.659884 28247 raft_consensus.cc:2454] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dc534f99d744d0ea5efb98ac3869d25 in term 0.
I20260809 16:19:42.659884 27953 leader_election.cc:302] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dc534f99d744d0ea5efb98ac3869d25, d2cd4555b38d416aa75d9893434ef4ea; no voters:
I20260809 16:19:42.660070 28343 raft_consensus.cc:2781] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 16:19:42.660127 28343 raft_consensus.cc:482] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 16:19:42.660143 28343 raft_consensus.cc:3037] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:42.660854 28343 raft_consensus.cc:504] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.660969 28343 leader_election.cc:288] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [CANDIDATE]: Term 1 election: Requested vote from peers 4530a34cc756426ab51d095a153196e8 (127.27.217.3:39497), d2cd4555b38d416aa75d9893434ef4ea (127.27.217.1:38611)
I20260809 16:19:42.661113 28247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f2745a516274dc08946762725f6214c" candidate_uuid: "4dc534f99d744d0ea5efb98ac3869d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4530a34cc756426ab51d095a153196e8"
I20260809 16:19:42.661166 27852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f2745a516274dc08946762725f6214c" candidate_uuid: "4dc534f99d744d0ea5efb98ac3869d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cd4555b38d416aa75d9893434ef4ea"
I20260809 16:19:42.661197 28247 raft_consensus.cc:3037] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:42.661233 27852 raft_consensus.cc:3037] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:42.662084 27852 raft_consensus.cc:2454] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dc534f99d744d0ea5efb98ac3869d25 in term 1.
I20260809 16:19:42.662084 28247 raft_consensus.cc:2454] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dc534f99d744d0ea5efb98ac3869d25 in term 1.
I20260809 16:19:42.662235 27953 leader_election.cc:302] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dc534f99d744d0ea5efb98ac3869d25, d2cd4555b38d416aa75d9893434ef4ea; no voters:
I20260809 16:19:42.662329 28343 raft_consensus.cc:2781] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:42.662460 28343 raft_consensus.cc:686] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 1 LEADER]: Becoming Leader. State: Replica: 4dc534f99d744d0ea5efb98ac3869d25, State: Running, Role: LEADER
I20260809 16:19:42.662542 28343 consensus_queue.cc:237] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } }
I20260809 16:19:42.663287 27636 catalog_manager.cc:5495] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dc534f99d744d0ea5efb98ac3869d25 (127.27.217.2). New cstate: current_term: 1 leader_uuid: "4dc534f99d744d0ea5efb98ac3869d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dc534f99d744d0ea5efb98ac3869d25" member_type: VOTER last_known_addr { host: "127.27.217.2" port: 36753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 } health_report { overall_health: UNKNOWN } } }
I20260809 16:19:42.729770 28327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.727660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57424 (local address 127.27.217.2:36753)
0809 16:19:42.727733 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:42.727735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:42.727760 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:19:42.727796 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:42.727797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:42.727815 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:42.727869 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:19:42.727970 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.728425 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.729175 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:42.729366 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:42.729411 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:42.729521 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:19:42.729617 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:19:42.729670 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:42.729683 (+ 13us) server_negotiation.cc:299] Negotiation successful
0809 16:19:42.729697 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 16:19:42.731477 28247 raft_consensus.cc:1261] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 1 FOLLOWER]: Refusing update from remote peer 4dc534f99d744d0ea5efb98ac3869d25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:42.731477 27852 raft_consensus.cc:1261] T 2f2745a516274dc08946762725f6214c P d2cd4555b38d416aa75d9893434ef4ea [term 1 FOLLOWER]: Refusing update from remote peer 4dc534f99d744d0ea5efb98ac3869d25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:19:42.731901 28346 consensus_queue.cc:1035] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4530a34cc756426ab51d095a153196e8" member_type: VOTER last_known_addr { host: "127.27.217.3" port: 39497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:42.732038 28343 consensus_queue.cc:1035] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cd4555b38d416aa75d9893434ef4ea" member_type: VOTER last_known_addr { host: "127.27.217.1" port: 38611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:19:42.734373 28350 mvcc.cc:205] Tried to move back new op lower bound from 7316653599665418240 to 7316653599386198016. Current Snapshot: MvccSnapshot[applied={T|T < 7316653599665418240}]
I20260809 16:19:42.734710 28353 mvcc.cc:205] Tried to move back new op lower bound from 7316653599665418240 to 7316653599386198016. Current Snapshot: MvccSnapshot[applied={T|T < 7316653599665418240}]
I20260809 16:19:42.735006 28352 mvcc.cc:205] Tried to move back new op lower bound from 7316653599665418240 to 7316653599386198016. Current Snapshot: MvccSnapshot[applied={T|T < 7316653599665418240 or (T in {7316653599665418240})}]
I20260809 16:19:42.737138 27635 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:42.737222 27635 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 16:19:42.737926 27635 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 23b555533f5a4f5cbe46d0a3a1093ebd: Sending DeleteTablet for 3 replicas of tablet 2f2745a516274dc08946762725f6214c
I20260809 16:19:42.738240 28215 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f2745a516274dc08946762725f6214c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:42 UTC) from {username='slave'} at 127.0.0.1:38346
I20260809 16:19:42.738271 27817 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f2745a516274dc08946762725f6214c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:42 UTC) from {username='slave'} at 127.0.0.1:54286
I20260809 16:19:42.738435 28025 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f2745a516274dc08946762725f6214c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 16:19:42 UTC) from {username='slave'} at 127.0.0.1:57420
I20260809 16:19:42.738577 28366 tablet_replica.cc:330] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: stopping tablet replica
I20260809 16:19:42.738688 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 27721
I20260809 16:19:42.738720 28366 raft_consensus.cc:2229] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 16:19:42.741292 28366 raft_consensus.cc:2258] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:42.743172 28366 ts_tablet_manager.cc:1905] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:42.744956 28366 ts_tablet_manager.cc:1918] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:42.745055 28366 log.cc:1196] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-2/wal/wals/2f2745a516274dc08946762725f6214c
I20260809 16:19:42.745363 28366 ts_tablet_manager.cc:1939] T 2f2745a516274dc08946762725f6214c P 4530a34cc756426ab51d095a153196e8: Deleting consensus metadata
I20260809 16:19:42.745838 27615 catalog_manager.cc:4841] TS 4530a34cc756426ab51d095a153196e8 (127.27.217.3:39497): tablet 2f2745a516274dc08946762725f6214c (table test-table [id=2b97ad5fb5a949f7885e8a31c1ebc938]) successfully deleted
I20260809 16:19:42.746865 28368 tablet_replica.cc:330] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: stopping tablet replica
I20260809 16:19:42.746971 28368 raft_consensus.cc:2229] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 1 LEADER]: Raft consensus shutting down.
I20260809 16:19:42.747105 28368 raft_consensus.cc:2258] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 16:19:42.747530 28368 ts_tablet_manager.cc:1905] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 16:19:42.748932 28368 ts_tablet_manager.cc:1918] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 16:19:42.748998 28368 log.cc:1196] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Deleting WAL directory at /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786292143139430-28516-0/minicluster-data/ts-1/wal/wals/2f2745a516274dc08946762725f6214c
I20260809 16:19:42.749208 28368 ts_tablet_manager.cc:1939] T 2f2745a516274dc08946762725f6214c P 4dc534f99d744d0ea5efb98ac3869d25: Deleting consensus metadata
I20260809 16:19:42.749616 27612 catalog_manager.cc:4841] TS 4dc534f99d744d0ea5efb98ac3869d25 (127.27.217.2:36753): tablet 2f2745a516274dc08946762725f6214c (table test-table [id=2b97ad5fb5a949f7885e8a31c1ebc938]) successfully deleted
I20260809 16:19:42.753749 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 27926
W20260809 16:19:42.753752 27614 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.217.1:38611 (error 108)
I20260809 16:19:42.755817 28326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:42.755660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.1:38611 (local address 127.0.0.1:54292)
0809 16:19:42.755735 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0809 16:19:42.755786 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.1:38611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 16:19:42.755939 27614 catalog_manager.cc:4584] TS d2cd4555b38d416aa75d9893434ef4ea (127.27.217.1:38611): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2f2745a516274dc08946762725f6214c: Network error: Client connection negotiation failed: client connection to 127.27.217.1:38611: connect: Connection refused (error 111)
I20260809 16:19:42.761255 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 28126
I20260809 16:19:42.772361 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 27592
2026-08-09T16:19:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (954 ms)
[----------] 6 tests from EncryptionPolicyTest (9045 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:42 dist-test-slave-nj21 krb5kdc[28375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:42 dist-test-slave-nj21 krb5kdc[28375](info): set up 2 sockets
Aug 09 16:19:42 dist-test-slave-nj21 krb5kdc[28375](info): commencing operation
krb5kdc: starting...
W20260809 16:19:43.919575 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:43 dist-test-slave-nj21 krb5kdc[28375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:44.030198 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46173
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:44.110231 28394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:44.110435 28394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:44.110458 28394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:44.111524 28394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:44.111563 28394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:44.111578 28394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:44.111595 28394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:44.111613 28394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:44.113080 28394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46173
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:44.113277 28394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:44.113456 28394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:44.118079 28404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:44.118119 28408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:44.118090 28405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:44.118314 28394 server_base.cc:1034] running on GCE node
I20260809 16:19:44.118535 28394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:44.118798 28394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:44.119943 28394 hybrid_clock.cc:648] HybridClock initialized: now 1786292384119925 us; error 29 us; skew 500 ppm
Aug 09 16:19:44 dist-test-slave-nj21 krb5kdc[28375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292384, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:44.126284 28394 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:44.126684 28394 webserver.cc:460] Webserver started at http://127.0.0.1:45547/ using document root <none> and password file <none>
I20260809 16:19:44.126885 28394 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:44.126924 28394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:44.127023 28394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:44.128085 28394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "c4ea23d06b434119b024a090aaa9b734"
format_stamp: "Formatted at 2026-08-09 16:19:44 on dist-test-slave-nj21"
server_key: "83fe7589f2fa37cec5329d55965a028c"
server_key_iv: "2868cd9b91ffbc2980dce70ba2090f40"
server_key_version: "encryptionkey@0"
I20260809 16:19:44.128407 28394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "c4ea23d06b434119b024a090aaa9b734"
format_stamp: "Formatted at 2026-08-09 16:19:44 on dist-test-slave-nj21"
server_key: "83fe7589f2fa37cec5329d55965a028c"
server_key_iv: "2868cd9b91ffbc2980dce70ba2090f40"
server_key_version: "encryptionkey@0"
I20260809 16:19:44.129673 28394 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:19:44.130316 28419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:44.130483 28394 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:44.130568 28394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "c4ea23d06b434119b024a090aaa9b734"
format_stamp: "Formatted at 2026-08-09 16:19:44 on dist-test-slave-nj21"
server_key: "83fe7589f2fa37cec5329d55965a028c"
server_key_iv: "2868cd9b91ffbc2980dce70ba2090f40"
server_key_version: "encryptionkey@0"
I20260809 16:19:44.130623 28394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:44.146052 28394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:44.148061 28394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:44.148170 28394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:44.151973 28394 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46173
I20260809 16:19:44.152014 28502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46173 every 8 connection(s)
I20260809 16:19:44.152318 28394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:44.153151 28504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:44.154250 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 28394
I20260809 16:19:44.154378 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:44.154578 28516 external_mini_cluster.cc:1428] Setting key a9d45fa3d8d01de4ef18b77fbc7028a6
I20260809 16:19:44.155844 28504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734: Bootstrap starting.
I20260809 16:19:44.156505 28504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:44.156829 28504 log.cc:824] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:44.157481 28504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734: No bootstrap required, opened a new log
I20260809 16:19:44.159334 28504 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4ea23d06b434119b024a090aaa9b734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46173 } }
I20260809 16:19:44.159513 28504 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:44.159564 28504 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4ea23d06b434119b024a090aaa9b734, State: Initialized, Role: FOLLOWER
I20260809 16:19:44.159706 28504 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4ea23d06b434119b024a090aaa9b734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46173 } }
I20260809 16:19:44.159783 28504 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:44.159806 28504 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:44.159852 28504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:44.160341 28504 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4ea23d06b434119b024a090aaa9b734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46173 } }
I20260809 16:19:44.160445 28504 leader_election.cc:302] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4ea23d06b434119b024a090aaa9b734; no voters:
I20260809 16:19:44.160597 28504 leader_election.cc:288] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:44.160627 28514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:44.160787 28514 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [term 1 LEADER]: Becoming Leader. State: Replica: c4ea23d06b434119b024a090aaa9b734, State: Running, Role: LEADER
I20260809 16:19:44.160844 28504 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:44.160974 28514 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4ea23d06b434119b024a090aaa9b734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46173 } }
Aug 09 16:19:44 dist-test-slave-nj21 krb5kdc[28375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 16:19:44.161366 28526 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4ea23d06b434119b024a090aaa9b734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4ea23d06b434119b024a090aaa9b734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46173 } } }
I20260809 16:19:44.161445 28526 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:44.161609 28515 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4ea23d06b434119b024a090aaa9b734. Latest consensus state: current_term: 1 leader_uuid: "c4ea23d06b434119b024a090aaa9b734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4ea23d06b434119b024a090aaa9b734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46173 } } }
I20260809 16:19:44.161659 28515 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:44.162047 28536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:44.162698 28536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:44.164215 28536 catalog_manager.cc:1347] Generated new cluster ID: 8b6b363dc3394dfab23dd1223a879b8e
I20260809 16:19:44.164264 28536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:44.165498 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:44.155111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33159 (local address 127.0.0.1:46173)
0809 16:19:44.155286 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:44.155296 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:44.155489 (+ 193us) server_negotiation.cc:407] Connection header received
0809 16:19:44.155974 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:44.155983 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:44.156032 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:44.156146 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:44.156908 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:44.157832 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:44.158535 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:44.158949 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:44.159041 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:44.161604 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:44.161608 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:44.161608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:44.161620 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:44.163498 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:44.163943 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:44.163945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:44.163945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:44.164023 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:44.164258 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:44.164259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:44.164259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:44.164596 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:44.164733 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:44.165197 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 16:19:44.165294 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260809 16:19:44.166450 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:44.171003 28536 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:44.171449 28536 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:44.174707 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:44.168077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33093 (local address 127.0.0.1:46173)
0809 16:19:44.168111 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:44.168113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:44.168135 (+ 22us) server_negotiation.cc:407] Connection header received
0809 16:19:44.168151 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:44.168151 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:44.168160 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:44.168199 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:44.168814 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:44.169561 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:44.170545 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:44.170798 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:44.170879 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:44.172189 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:44.172190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:44.172190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:44.172197 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:44.173615 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:44.174003 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:44.174003 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:44.174004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:44.174050 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:44.174244 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:44.174244 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:44.174245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:44.174348 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:44.174435 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:44.174572 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 16:19:44.174628 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:19:44.175300 28536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4ea23d06b434119b024a090aaa9b734: Generated new TSK 0
I20260809 16:19:44.175454 28536 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:44.179103 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 28394
W20260809 16:19:44.197402 28370 connection.cc:535] client connection to 127.0.0.1:46173 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46173): Connection reset by peer (error 104)
2026-08-09T16:19:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1416 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:44 dist-test-slave-nj21 krb5kdc[28563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:44 dist-test-slave-nj21 krb5kdc[28563](info): set up 2 sockets
Aug 09 16:19:44 dist-test-slave-nj21 krb5kdc[28563](info): commencing operation
krb5kdc: starting...
W20260809 16:19:45.330250 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:45 dist-test-slave-nj21 krb5kdc[28563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:45.441987 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37079
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:45.520025 28581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:45.520218 28581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:45.520248 28581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:45.521353 28581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:45.521394 28581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:45.521412 28581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:45.521427 28581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:45.521442 28581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:45.522876 28581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37079
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:45.523108 28581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:45.523298 28581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:45.527791 28595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:45.527799 28591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:45.527953 28581 server_base.cc:1034] running on GCE node
W20260809 16:19:45.527808 28593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:45.528251 28581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:45.528529 28581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:45.529661 28581 hybrid_clock.cc:648] HybridClock initialized: now 1786292385529641 us; error 33 us; skew 500 ppm
Aug 09 16:19:45 dist-test-slave-nj21 krb5kdc[28563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292385, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:45.531903 28581 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:45.532287 28581 webserver.cc:460] Webserver started at http://127.0.0.1:43823/ using document root <none> and password file <none>
I20260809 16:19:45.532478 28581 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:45.532526 28581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:45.532647 28581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:45.533615 28581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "80996887aad749f98ae1eeed5c326987"
format_stamp: "Formatted at 2026-08-09 16:19:45 on dist-test-slave-nj21"
server_key: "0ddffc97f7db750acdb1b67a0fe2c541"
server_key_iv: "09ba940f2c48ccbdaccf75203dfa0794"
server_key_version: "encryptionkey@0"
I20260809 16:19:45.533931 28581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "80996887aad749f98ae1eeed5c326987"
format_stamp: "Formatted at 2026-08-09 16:19:45 on dist-test-slave-nj21"
server_key: "0ddffc97f7db750acdb1b67a0fe2c541"
server_key_iv: "09ba940f2c48ccbdaccf75203dfa0794"
server_key_version: "encryptionkey@0"
I20260809 16:19:45.535094 28581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:45.535725 28603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:45.535857 28581 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:45.535941 28581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "80996887aad749f98ae1eeed5c326987"
format_stamp: "Formatted at 2026-08-09 16:19:45 on dist-test-slave-nj21"
server_key: "0ddffc97f7db750acdb1b67a0fe2c541"
server_key_iv: "09ba940f2c48ccbdaccf75203dfa0794"
server_key_version: "encryptionkey@0"
I20260809 16:19:45.536000 28581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:45.554247 28581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:45.555815 28581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:45.555949 28581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:45.559629 28581 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37079
I20260809 16:19:45.559665 28679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37079 every 8 connection(s)
I20260809 16:19:45.560014 28581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:45.560767 28680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:45.562881 28680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987: Bootstrap starting.
I20260809 16:19:45.563412 28680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:45.563663 28680 log.cc:824] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:45.564324 28680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987: No bootstrap required, opened a new log
I20260809 16:19:45.565799 28680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80996887aad749f98ae1eeed5c326987" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37079 } }
I20260809 16:19:45.565937 28680 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:45.565970 28680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80996887aad749f98ae1eeed5c326987, State: Initialized, Role: FOLLOWER
I20260809 16:19:45.566107 28680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80996887aad749f98ae1eeed5c326987" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37079 } }
I20260809 16:19:45.566164 28680 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:45.566186 28680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:45.566212 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 28581
I20260809 16:19:45.566231 28680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:45.566319 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:45.566501 28516 external_mini_cluster.cc:1428] Setting key 27f5d6bdddf15f20e79b9c5025c8ef6b
I20260809 16:19:45.566767 28680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80996887aad749f98ae1eeed5c326987" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37079 } }
I20260809 16:19:45.566880 28680 leader_election.cc:302] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80996887aad749f98ae1eeed5c326987; no voters:
I20260809 16:19:45.567045 28680 leader_election.cc:288] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:45.567121 28688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:45.567291 28680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:45.567299 28688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [term 1 LEADER]: Becoming Leader. State: Replica: 80996887aad749f98ae1eeed5c326987, State: Running, Role: LEADER
I20260809 16:19:45.567732 28688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80996887aad749f98ae1eeed5c326987" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37079 } }
I20260809 16:19:45.568099 28693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80996887aad749f98ae1eeed5c326987. Latest consensus state: current_term: 1 leader_uuid: "80996887aad749f98ae1eeed5c326987" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80996887aad749f98ae1eeed5c326987" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37079 } } }
I20260809 16:19:45.568176 28693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:45.568501 28692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80996887aad749f98ae1eeed5c326987" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80996887aad749f98ae1eeed5c326987" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37079 } } }
I20260809 16:19:45.568574 28692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987 [sys.catalog]: This master's current role is: LEADER
W20260809 16:19:45.569169 28713 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:19:45.569221 28713 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:19:45.569269 28702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:45.569460 28702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:45.570812 28702 catalog_manager.cc:1347] Generated new cluster ID: bc928468bc1e439980d518611aa2fd36
I20260809 16:19:45.570863 28702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:45.572450 28687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:45.566913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55583 (local address 127.0.0.1:37079)
0809 16:19:45.567098 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:45.567108 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:45.567140 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:19:45.567249 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:45.567255 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:45.567307 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:45.567438 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:45.567631 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:45.569357 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:45.570426 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:45.571009 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:45.571107 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:45.571801 (+ 694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:45.571805 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:45.571806 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:45.571998 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:45.572034 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:45.572048 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:45.572137 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:45.572205 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 16:19:45.572231 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260809 16:19:45.573282 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:45.578022 28702 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:45.578609 28702 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:45.581902 28702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80996887aad749f98ae1eeed5c326987: Generated new TSK 0
I20260809 16:19:45.582068 28702 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:45.584316 28687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:45.574717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44587 (local address 127.0.0.1:37079)
0809 16:19:45.574747 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:45.574749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:45.577941 (+ 3192us) server_negotiation.cc:407] Connection header received
0809 16:19:45.581651 (+ 3710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:45.581652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:45.581663 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:45.581711 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:45.581902 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:45.582494 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:45.583186 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:45.583417 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:45.583473 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:45.584095 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:45.584097 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:45.584097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:45.584101 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:45.584114 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:45.584118 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:45.584169 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:45.584230 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 16:19:45.584243 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 16:19:45.586140 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 28581
W20260809 16:19:45.603796 28560 connection.cc:535] client connection to 127.0.0.1:37079 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37079): Connection reset by peer (error 104)
2026-08-09T16:19:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1406 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:45 dist-test-slave-nj21 krb5kdc[28728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:45 dist-test-slave-nj21 krb5kdc[28728](info): set up 2 sockets
Aug 09 16:19:45 dist-test-slave-nj21 krb5kdc[28728](info): commencing operation
krb5kdc: starting...
W20260809 16:19:46.734675 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:46 dist-test-slave-nj21 krb5kdc[28728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:46.846015 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35185
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:46.924667 28754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:46.924860 28754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:46.924888 28754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:46.926007 28754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:46.926048 28754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:46.926066 28754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:46.926082 28754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:46.926096 28754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:46.927498 28754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35185
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:46.927771 28754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:46.927975 28754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:46.932448 28761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:46.932490 28760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:46.932490 28765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:46.932803 28754 server_base.cc:1034] running on GCE node
I20260809 16:19:46.933036 28754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:46.933295 28754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:46.934440 28754 hybrid_clock.cc:648] HybridClock initialized: now 1786292386934425 us; error 26 us; skew 500 ppm
Aug 09 16:19:46 dist-test-slave-nj21 krb5kdc[28728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292386, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:46.936755 28754 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:46.937170 28754 webserver.cc:460] Webserver started at http://127.0.0.1:38683/ using document root <none> and password file <none>
I20260809 16:19:46.937368 28754 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:46.937414 28754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:46.937537 28754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:46.938508 28754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "bb45b16544e8406286f25ab697eee74a"
format_stamp: "Formatted at 2026-08-09 16:19:46 on dist-test-slave-nj21"
server_key: "f2d269d16e179a69ce9527a592cc2c95"
server_key_iv: "0d9b7a45e6312c76b4270277aae45d8c"
server_key_version: "encryptionkey@0"
I20260809 16:19:46.938833 28754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "bb45b16544e8406286f25ab697eee74a"
format_stamp: "Formatted at 2026-08-09 16:19:46 on dist-test-slave-nj21"
server_key: "f2d269d16e179a69ce9527a592cc2c95"
server_key_iv: "0d9b7a45e6312c76b4270277aae45d8c"
server_key_version: "encryptionkey@0"
I20260809 16:19:46.940088 28754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:46.940788 28777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:46.940939 28754 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:46.941023 28754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "bb45b16544e8406286f25ab697eee74a"
format_stamp: "Formatted at 2026-08-09 16:19:46 on dist-test-slave-nj21"
server_key: "f2d269d16e179a69ce9527a592cc2c95"
server_key_iv: "0d9b7a45e6312c76b4270277aae45d8c"
server_key_version: "encryptionkey@0"
I20260809 16:19:46.941089 28754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:46.944167 28754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:46.946133 28754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:46.946260 28754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:46.949970 28754 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35185
I20260809 16:19:46.950019 28849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35185 every 8 connection(s)
I20260809 16:19:46.950286 28754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:46.951176 28850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:46.953452 28850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a: Bootstrap starting.
I20260809 16:19:46.953985 28850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:46.954210 28850 log.cc:824] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:46.954798 28850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a: No bootstrap required, opened a new log
I20260809 16:19:46.956357 28850 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb45b16544e8406286f25ab697eee74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35185 } }
I20260809 16:19:46.956498 28850 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:46.956528 28850 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb45b16544e8406286f25ab697eee74a, State: Initialized, Role: FOLLOWER
I20260809 16:19:46.956630 28850 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb45b16544e8406286f25ab697eee74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35185 } }
I20260809 16:19:46.956677 28850 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:46.956700 28850 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:46.956729 28850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:46.957181 28850 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb45b16544e8406286f25ab697eee74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35185 } }
I20260809 16:19:46.957263 28850 leader_election.cc:302] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb45b16544e8406286f25ab697eee74a; no voters:
I20260809 16:19:46.957378 28850 leader_election.cc:288] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:46.957432 28856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:46.957603 28856 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [term 1 LEADER]: Becoming Leader. State: Replica: bb45b16544e8406286f25ab697eee74a, State: Running, Role: LEADER
I20260809 16:19:46.957600 28850 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:46.957710 28856 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb45b16544e8406286f25ab697eee74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35185 } }
I20260809 16:19:46.958087 28858 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb45b16544e8406286f25ab697eee74a. Latest consensus state: current_term: 1 leader_uuid: "bb45b16544e8406286f25ab697eee74a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb45b16544e8406286f25ab697eee74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35185 } } }
I20260809 16:19:46.958228 28858 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:46.958104 28857 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb45b16544e8406286f25ab697eee74a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb45b16544e8406286f25ab697eee74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35185 } } }
I20260809 16:19:46.958422 28857 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:46.958668 28861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:46.959137 28861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:46.960160 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 28754
I20260809 16:19:46.960278 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:46.960460 28516 external_mini_cluster.cc:1428] Setting key d8f843fb443db043e4bf0d8fb8e606bf
I20260809 16:19:46.960729 28861 catalog_manager.cc:1347] Generated new cluster ID: e627ff7b30ec4e93a546271b4b1fd019
I20260809 16:19:46.960803 28861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:46.962538 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:46.960872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44355 (local address 127.0.0.1:35185)
0809 16:19:46.961102 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:46.961110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:46.961144 (+ 34us) server_negotiation.cc:407] Connection header received
0809 16:19:46.961252 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:46.961258 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:46.961286 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:46.961435 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:46.962045 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:46.962048 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:46.962049 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:46.962052 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:46.962084 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:46.962098 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:46.962165 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:46.962220 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 16:19:46.962356 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":72,"threads_started":1}
I20260809 16:19:46.963384 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:46.965934 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:46.965018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56961 (local address 127.0.0.1:35185)
0809 16:19:46.965066 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:46.965068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:46.965076 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:46.965164 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:46.965164 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:46.965169 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:46.965214 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:46.965752 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:46.965752 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:46.965753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:46.965756 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:46.965769 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:46.965773 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:46.965812 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:46.965863 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 16:19:46.965877 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 16:19:46.971959 28861 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:46.972101 28861 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:46.978341 28861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb45b16544e8406286f25ab697eee74a: Generated new TSK 0
I20260809 16:19:46.978490 28861 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:46.981642 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 28754
2026-08-09T16:19:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1389 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:47 dist-test-slave-nj21 krb5kdc[28907](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:47 dist-test-slave-nj21 krb5kdc[28907](info): set up 2 sockets
Aug 09 16:19:47 dist-test-slave-nj21 krb5kdc[28907](info): commencing operation
krb5kdc: starting...
W20260809 16:19:48.146725 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:48 dist-test-slave-nj21 krb5kdc[28907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:48.258582 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42233
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:48.338059 28928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:48.338256 28928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:48.338287 28928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:48.339383 28928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:48.339423 28928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:48.339452 28928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:48.339468 28928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:48.339484 28928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:48.340965 28928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:48.341198 28928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:48.341400 28928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:48.345872 28936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:48.345948 28937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:48.345885 28939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:48.345964 28928 server_base.cc:1034] running on GCE node
I20260809 16:19:48.346333 28928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:48.346627 28928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:48.347719 28928 hybrid_clock.cc:648] HybridClock initialized: now 1786292388347702 us; error 32 us; skew 500 ppm
Aug 09 16:19:48 dist-test-slave-nj21 krb5kdc[28907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292388, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:48.350037 28928 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:48.350449 28928 webserver.cc:460] Webserver started at http://127.0.0.1:37067/ using document root <none> and password file <none>
I20260809 16:19:48.350620 28928 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:48.350657 28928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:48.350749 28928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:48.351732 28928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "43f9a8a2df4b438a938b467496f92358"
format_stamp: "Formatted at 2026-08-09 16:19:48 on dist-test-slave-nj21"
server_key: "eb72f33a4d291f542a5f99a092fe218b"
server_key_iv: "86ad2034075056dad1405e8d688ec982"
server_key_version: "encryptionkey@0"
I20260809 16:19:48.352035 28928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "43f9a8a2df4b438a938b467496f92358"
format_stamp: "Formatted at 2026-08-09 16:19:48 on dist-test-slave-nj21"
server_key: "eb72f33a4d291f542a5f99a092fe218b"
server_key_iv: "86ad2034075056dad1405e8d688ec982"
server_key_version: "encryptionkey@0"
I20260809 16:19:48.353185 28928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:19:48.353832 28947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:48.353981 28928 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:48.354054 28928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "43f9a8a2df4b438a938b467496f92358"
format_stamp: "Formatted at 2026-08-09 16:19:48 on dist-test-slave-nj21"
server_key: "eb72f33a4d291f542a5f99a092fe218b"
server_key_iv: "86ad2034075056dad1405e8d688ec982"
server_key_version: "encryptionkey@0"
I20260809 16:19:48.354115 28928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:48.365407 28928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:48.367079 28928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:48.367204 28928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:48.370949 28928 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42233
I20260809 16:19:48.370992 29028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42233 every 8 connection(s)
I20260809 16:19:48.371286 28928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:48.372139 29029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:48.372884 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 28928
I20260809 16:19:48.372995 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:48.373157 28516 external_mini_cluster.cc:1428] Setting key c158d9106703357e0075b38ab8d40ba1
I20260809 16:19:48.375082 29029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358: Bootstrap starting.
I20260809 16:19:48.375643 29029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:48.375972 29029 log.cc:824] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:48.376680 29029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358: No bootstrap required, opened a new log
I20260809 16:19:48.378919 29029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f9a8a2df4b438a938b467496f92358" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42233 } }
I20260809 16:19:48.379101 29029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:48.379129 29029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f9a8a2df4b438a938b467496f92358, State: Initialized, Role: FOLLOWER
I20260809 16:19:48.379253 29029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f9a8a2df4b438a938b467496f92358" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42233 } }
I20260809 16:19:48.379316 29029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:48.379338 29029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:48.379382 29029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 16:19:48 dist-test-slave-nj21 krb5kdc[28907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 16:19:48.379968 29029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f9a8a2df4b438a938b467496f92358" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42233 } }
I20260809 16:19:48.380064 29029 leader_election.cc:302] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43f9a8a2df4b438a938b467496f92358; no voters:
I20260809 16:19:48.380223 29029 leader_election.cc:288] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:48.380254 29036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:48.380447 29036 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [term 1 LEADER]: Becoming Leader. State: Replica: 43f9a8a2df4b438a938b467496f92358, State: Running, Role: LEADER
I20260809 16:19:48.380538 29029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:48.380577 29036 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f9a8a2df4b438a938b467496f92358" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42233 } }
I20260809 16:19:48.380926 29036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43f9a8a2df4b438a938b467496f92358. Latest consensus state: current_term: 1 leader_uuid: "43f9a8a2df4b438a938b467496f92358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f9a8a2df4b438a938b467496f92358" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42233 } } }
I20260809 16:19:48.381148 29036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:48.381081 29038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43f9a8a2df4b438a938b467496f92358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43f9a8a2df4b438a938b467496f92358" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42233 } } }
I20260809 16:19:48.381554 29038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:48.381774 29046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:48.382282 29046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:48.383805 29046 catalog_manager.cc:1347] Generated new cluster ID: a9130be7f62140058fa326445334202d
I20260809 16:19:48.383859 29046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:48.385040 29034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:48.373622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54411 (local address 127.0.0.1:42233)
0809 16:19:48.373763 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:48.373770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:48.373795 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:19:48.374192 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:48.374198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:48.374242 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:48.374353 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:48.375102 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:48.376043 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:48.377017 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:48.377417 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:48.377494 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:48.380143 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:48.380147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:48.380148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:48.380160 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:48.383615 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:48.384009 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:48.384013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:48.384013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:48.384108 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:48.384281 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:48.384282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:48.384282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:48.384515 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:48.384653 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:48.384752 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 16:19:48.384883 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
I20260809 16:19:48.385851 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:48.392187 29046 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:48.392824 29046 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:48.396790 29034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:48.387931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41003 (local address 127.0.0.1:42233)
0809 16:19:48.387964 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:48.387966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:48.391402 (+ 3436us) server_negotiation.cc:407] Connection header received
0809 16:19:48.391427 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:48.391428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:48.391438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:48.391497 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:48.392164 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:48.392670 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:48.393356 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:48.393567 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:48.393621 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:48.394647 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:48.394648 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:48.394648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:48.394655 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:48.395844 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:48.396138 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:48.396140 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:48.396140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:48.396189 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:48.396344 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:48.396345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:48.396345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:48.396443 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:48.396522 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:48.396628 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 16:19:48.396708 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:19:48.397217 29046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43f9a8a2df4b438a938b467496f92358: Generated new TSK 0
I20260809 16:19:48.397358 29046 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:48.400002 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 28928
2026-08-09T16:19:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1421 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:48 dist-test-slave-nj21 krb5kdc[29067](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:48 dist-test-slave-nj21 krb5kdc[29067](info): set up 2 sockets
Aug 09 16:19:48 dist-test-slave-nj21 krb5kdc[29067](info): commencing operation
krb5kdc: starting...
W20260809 16:19:49.545543 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:49 dist-test-slave-nj21 krb5kdc[29067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292389, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:49.659771 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45093
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:49.740665 29088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:49.740865 29088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:49.740896 29088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:49.742023 29088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:49.742069 29088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:49.742087 29088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:49.742105 29088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:49.742120 29088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:49.743592 29088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:49.743850 29088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:49.744067 29088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:49.748695 29098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:49.748826 29088 server_base.cc:1034] running on GCE node
W20260809 16:19:49.748742 29096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:49.748756 29101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:49.749167 29088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:49.749477 29088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:49.750629 29088 hybrid_clock.cc:648] HybridClock initialized: now 1786292389750613 us; error 31 us; skew 500 ppm
Aug 09 16:19:49 dist-test-slave-nj21 krb5kdc[29067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292389, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:49.755879 29088 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:49.756278 29088 webserver.cc:460] Webserver started at http://127.0.0.1:33355/ using document root <none> and password file <none>
I20260809 16:19:49.756488 29088 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:49.756537 29088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:49.756664 29088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:49.757653 29088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "57ac1c9280b04b059a7014642d94b3de"
format_stamp: "Formatted at 2026-08-09 16:19:49 on dist-test-slave-nj21"
server_key: "a443531e5a933730daca7b49acbf99db"
server_key_iv: "397ed068025c017e87fc8322c4213fdf"
server_key_version: "encryptionkey@0"
I20260809 16:19:49.758010 29088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "57ac1c9280b04b059a7014642d94b3de"
format_stamp: "Formatted at 2026-08-09 16:19:49 on dist-test-slave-nj21"
server_key: "a443531e5a933730daca7b49acbf99db"
server_key_iv: "397ed068025c017e87fc8322c4213fdf"
server_key_version: "encryptionkey@0"
I20260809 16:19:49.759253 29088 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:19:49.759948 29109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:49.760082 29088 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:49.760169 29088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "57ac1c9280b04b059a7014642d94b3de"
format_stamp: "Formatted at 2026-08-09 16:19:49 on dist-test-slave-nj21"
server_key: "a443531e5a933730daca7b49acbf99db"
server_key_iv: "397ed068025c017e87fc8322c4213fdf"
server_key_version: "encryptionkey@0"
I20260809 16:19:49.760227 29088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:49.784034 29088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:49.785650 29088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:49.785787 29088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:49.789431 29088 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45093
I20260809 16:19:49.789490 29191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45093 every 8 connection(s)
I20260809 16:19:49.789795 29088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:49.790581 29192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:49.792749 29192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de: Bootstrap starting.
I20260809 16:19:49.793290 29192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:49.793540 29192 log.cc:824] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:49.794176 29192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de: No bootstrap required, opened a new log
I20260809 16:19:49.794186 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29088
I20260809 16:19:49.794283 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:49.794463 28516 external_mini_cluster.cc:1428] Setting key 8e69793470b91d1af0e051638695b3f1
I20260809 16:19:49.796162 29192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57ac1c9280b04b059a7014642d94b3de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } }
I20260809 16:19:49.796324 29192 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:49.796399 29192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57ac1c9280b04b059a7014642d94b3de, State: Initialized, Role: FOLLOWER
I20260809 16:19:49.796546 29192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57ac1c9280b04b059a7014642d94b3de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } }
I20260809 16:19:49.796620 29192 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:49.796651 29192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:49.796698 29192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:49.797206 29192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57ac1c9280b04b059a7014642d94b3de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } }
I20260809 16:19:49.797297 29192 leader_election.cc:302] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57ac1c9280b04b059a7014642d94b3de; no voters:
I20260809 16:19:49.797443 29192 leader_election.cc:288] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:49.797490 29200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:49.797609 29200 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [term 1 LEADER]: Becoming Leader. State: Replica: 57ac1c9280b04b059a7014642d94b3de, State: Running, Role: LEADER
I20260809 16:19:49.797699 29192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:49.797747 29200 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57ac1c9280b04b059a7014642d94b3de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } }
I20260809 16:19:49.798732 29201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57ac1c9280b04b059a7014642d94b3de. Latest consensus state: current_term: 1 leader_uuid: "57ac1c9280b04b059a7014642d94b3de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57ac1c9280b04b059a7014642d94b3de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } } }
I20260809 16:19:49.798812 29201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:49.799063 29221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:49.799189 29203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57ac1c9280b04b059a7014642d94b3de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57ac1c9280b04b059a7014642d94b3de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } } }
I20260809 16:19:49.799268 29203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:49.799604 29221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:49.800909 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:49.794944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49667 (local address 127.0.0.1:45093)
0809 16:19:49.795127 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:49.795136 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:49.795168 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:19:49.796129 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:49.796138 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:49.796202 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:49.796348 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:49.796542 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:49.797856 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:49.798938 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:49.799481 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:49.799583 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:49.800196 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:49.800199 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:49.800200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:49.800406 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:49.800453 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:49.800467 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:49.800530 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:49.800625 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 16:19:49.800686 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":74,"threads_started":1}
I20260809 16:19:49.801199 29221 catalog_manager.cc:1347] Generated new cluster ID: 8793c786eab84a6a8a1d71c830a8f9c4
I20260809 16:19:49.801254 29221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:49.801720 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:49.805469 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:49.802952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39635 (local address 127.0.0.1:45093)
0809 16:19:49.802985 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:49.802987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:49.803109 (+ 122us) server_negotiation.cc:407] Connection header received
0809 16:19:49.803159 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:49.803160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:49.803170 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:49.803214 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:49.803327 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:49.803826 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:49.804484 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:49.804678 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:49.804729 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:49.805254 (+ 525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:49.805255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:49.805255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:49.805259 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:49.805272 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:49.805276 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:49.805319 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:49.805371 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 16:19:49.805392 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:19:49.834800 29221 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:49.835335 29221 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:49.843839 29221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57ac1c9280b04b059a7014642d94b3de: Generated new TSK 0
I20260809 16:19:49.844026 29221 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:49.848385 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29088
2026-08-09T16:19:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1445 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:49 dist-test-slave-nj21 krb5kdc[29233](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:49 dist-test-slave-nj21 krb5kdc[29233](info): set up 2 sockets
Aug 09 16:19:49 dist-test-slave-nj21 krb5kdc[29233](info): commencing operation
krb5kdc: starting...
W20260809 16:19:50.999050 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:51 dist-test-slave-nj21 krb5kdc[29233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292391, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:51.110234 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35793
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:51.190066 29249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:51.190263 29249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:51.190294 29249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:51.191425 29249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:51.191468 29249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:51.191486 29249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:51.191504 29249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:51.191519 29249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:51.192968 29249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35793
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:51.193195 29249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:51.193403 29249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:51.197945 29255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:51.197958 29264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:51.198093 29249 server_base.cc:1034] running on GCE node
W20260809 16:19:51.197958 29256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:51.198390 29249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:51.198680 29249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:51.199810 29249 hybrid_clock.cc:648] HybridClock initialized: now 1786292391199795 us; error 28 us; skew 500 ppm
Aug 09 16:19:51 dist-test-slave-nj21 krb5kdc[29233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292391, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:51.202068 29249 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:51.202458 29249 webserver.cc:460] Webserver started at http://127.0.0.1:39973/ using document root <none> and password file <none>
I20260809 16:19:51.202662 29249 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:51.202708 29249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:51.202828 29249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:51.203862 29249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "a31c258be65b41b9adc0d5edeb668639"
format_stamp: "Formatted at 2026-08-09 16:19:51 on dist-test-slave-nj21"
server_key: "e3b2a5289154327790631997ba1e6acd"
server_key_iv: "5783ecfad8371af8d8054dd255675563"
server_key_version: "encryptionkey@0"
I20260809 16:19:51.204200 29249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "a31c258be65b41b9adc0d5edeb668639"
format_stamp: "Formatted at 2026-08-09 16:19:51 on dist-test-slave-nj21"
server_key: "e3b2a5289154327790631997ba1e6acd"
server_key_iv: "5783ecfad8371af8d8054dd255675563"
server_key_version: "encryptionkey@0"
I20260809 16:19:51.205402 29249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 16:19:51.206018 29272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:51.206167 29249 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:51.206251 29249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "a31c258be65b41b9adc0d5edeb668639"
format_stamp: "Formatted at 2026-08-09 16:19:51 on dist-test-slave-nj21"
server_key: "e3b2a5289154327790631997ba1e6acd"
server_key_iv: "5783ecfad8371af8d8054dd255675563"
server_key_version: "encryptionkey@0"
I20260809 16:19:51.206305 29249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:51.209476 29249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:51.211066 29249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:51.211190 29249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:51.214946 29249 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35793
I20260809 16:19:51.214982 29356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35793 every 8 connection(s)
I20260809 16:19:51.215253 29249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:51.216202 29357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:51.218320 29357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639: Bootstrap starting.
I20260809 16:19:51.218814 29357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:51.219046 29357 log.cc:824] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:51.219635 29357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639: No bootstrap required, opened a new log
I20260809 16:19:51.221136 29357 raft_consensus.cc:348] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c258be65b41b9adc0d5edeb668639" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35793 } }
I20260809 16:19:51.221263 29357 raft_consensus.cc:374] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:51.221289 29357 raft_consensus.cc:729] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a31c258be65b41b9adc0d5edeb668639, State: Initialized, Role: FOLLOWER
I20260809 16:19:51.221395 29357 consensus_queue.cc:260] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c258be65b41b9adc0d5edeb668639" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35793 } }
I20260809 16:19:51.221467 29357 raft_consensus.cc:388] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:51.221495 29357 raft_consensus.cc:482] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:51.221527 29357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:51.221973 29357 raft_consensus.cc:504] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c258be65b41b9adc0d5edeb668639" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35793 } }
I20260809 16:19:51.222054 29357 leader_election.cc:302] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a31c258be65b41b9adc0d5edeb668639; no voters:
I20260809 16:19:51.222165 29357 leader_election.cc:288] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:51.222209 29363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:51.222375 29357 sys_catalog.cc:564] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:51.222388 29363 raft_consensus.cc:686] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [term 1 LEADER]: Becoming Leader. State: Replica: a31c258be65b41b9adc0d5edeb668639, State: Running, Role: LEADER
I20260809 16:19:51.222502 29363 consensus_queue.cc:237] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c258be65b41b9adc0d5edeb668639" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35793 } }
I20260809 16:19:51.223017 29366 sys_catalog.cc:455] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a31c258be65b41b9adc0d5edeb668639. Latest consensus state: current_term: 1 leader_uuid: "a31c258be65b41b9adc0d5edeb668639" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c258be65b41b9adc0d5edeb668639" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35793 } } }
I20260809 16:19:51.223024 29364 sys_catalog.cc:455] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a31c258be65b41b9adc0d5edeb668639" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c258be65b41b9adc0d5edeb668639" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35793 } } }
I20260809 16:19:51.223119 29366 sys_catalog.cc:458] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:51.223124 29364 sys_catalog.cc:458] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:51.223306 29377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:51.223825 29377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:51.224676 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29249
I20260809 16:19:51.224792 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:51.224977 28516 external_mini_cluster.cc:1428] Setting key c9988f02bb7e185dba4933bd903440e7
I20260809 16:19:51.225540 29377 catalog_manager.cc:1347] Generated new cluster ID: 8fbaf9661008423e961b14a6a39d4942
I20260809 16:19:51.225592 29377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:51.233269 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:51.225395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45327 (local address 127.0.0.1:35793)
0809 16:19:51.225553 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:51.225563 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:51.231939 (+ 6376us) server_negotiation.cc:407] Connection header received
0809 16:19:51.232055 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:51.232061 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:51.232082 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:51.232187 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:51.232854 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:51.232857 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:51.232858 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:51.232862 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:51.232906 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:51.232917 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:51.232971 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:51.233045 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 16:19:51.233088 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
I20260809 16:19:51.233981 29377 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:51.234122 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:51.234162 29377 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:51.237896 29377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a31c258be65b41b9adc0d5edeb668639: Generated new TSK 0
I20260809 16:19:51.238044 29377 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:51.238581 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:51.235936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48289 (local address 127.0.0.1:35793)
0809 16:19:51.235967 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:51.235969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:51.237692 (+ 1723us) server_negotiation.cc:407] Connection header received
0809 16:19:51.237827 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:51.237828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:51.237832 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:51.237887 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:51.238403 (+ 516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:51.238404 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:51.238404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:51.238408 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:51.238421 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:51.238425 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:51.238471 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:51.238511 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 16:19:51.238523 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:19:51.240412 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29249
2026-08-09T16:19:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1401 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:51 dist-test-slave-nj21 krb5kdc[29406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:51 dist-test-slave-nj21 krb5kdc[29406](info): set up 2 sockets
Aug 09 16:19:51 dist-test-slave-nj21 krb5kdc[29406](info): commencing operation
krb5kdc: starting...
W20260809 16:19:52.403882 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:52 dist-test-slave-nj21 krb5kdc[29406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:52.517724 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41359
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:52.595809 29424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:52.595992 29424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:52.596014 29424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:52.597077 29424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:52.597110 29424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:52.597121 29424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:52.597132 29424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:52.597142 29424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:52.598546 29424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:52.598730 29424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:52.598887 29424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:52.603714 29435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:52.603814 29432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:52.603725 29433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:52.604354 29424 server_base.cc:1034] running on GCE node
I20260809 16:19:52.604660 29424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:52.604921 29424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:52.606058 29424 hybrid_clock.cc:648] HybridClock initialized: now 1786292392606047 us; error 32 us; skew 500 ppm
Aug 09 16:19:52 dist-test-slave-nj21 krb5kdc[29406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292392, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:52.608369 29424 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:52.608790 29424 webserver.cc:460] Webserver started at http://127.0.0.1:44763/ using document root <none> and password file <none>
I20260809 16:19:52.608970 29424 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:52.609009 29424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:52.609095 29424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:52.610044 29424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "cd0126f3631c45fcb11aefb3c17a04bf"
format_stamp: "Formatted at 2026-08-09 16:19:52 on dist-test-slave-nj21"
server_key: "43f004ee651047b5fdc5e4b0589de313"
server_key_iv: "f531a48b9068bc0b249d6d2b42e1f177"
server_key_version: "encryptionkey@0"
I20260809 16:19:52.610323 29424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "cd0126f3631c45fcb11aefb3c17a04bf"
format_stamp: "Formatted at 2026-08-09 16:19:52 on dist-test-slave-nj21"
server_key: "43f004ee651047b5fdc5e4b0589de313"
server_key_iv: "f531a48b9068bc0b249d6d2b42e1f177"
server_key_version: "encryptionkey@0"
I20260809 16:19:52.611529 29424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:19:52.612222 29442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:52.612391 29424 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:52.612484 29424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "cd0126f3631c45fcb11aefb3c17a04bf"
format_stamp: "Formatted at 2026-08-09 16:19:52 on dist-test-slave-nj21"
server_key: "43f004ee651047b5fdc5e4b0589de313"
server_key_iv: "f531a48b9068bc0b249d6d2b42e1f177"
server_key_version: "encryptionkey@0"
I20260809 16:19:52.612557 29424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:52.620813 29424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:52.622496 29424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:52.622618 29424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:52.626397 29424 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41359
I20260809 16:19:52.626438 29534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41359 every 8 connection(s)
I20260809 16:19:52.626717 29424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:52.627532 29540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:52.629757 29540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf: Bootstrap starting.
I20260809 16:19:52.630254 29540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:52.630486 29540 log.cc:824] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:52.631105 29540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf: No bootstrap required, opened a new log
I20260809 16:19:52.631732 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29424
I20260809 16:19:52.631851 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:52.632019 28516 external_mini_cluster.cc:1428] Setting key 69da2ec44f3a6d9fd7efce9a72b7c939
I20260809 16:19:52.632966 29540 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0126f3631c45fcb11aefb3c17a04bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41359 } }
I20260809 16:19:52.633107 29540 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:52.633143 29540 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0126f3631c45fcb11aefb3c17a04bf, State: Initialized, Role: FOLLOWER
I20260809 16:19:52.633268 29540 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0126f3631c45fcb11aefb3c17a04bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41359 } }
I20260809 16:19:52.633347 29540 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:52.633384 29540 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:52.633440 29540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:52.634223 29540 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0126f3631c45fcb11aefb3c17a04bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41359 } }
I20260809 16:19:52.634321 29540 leader_election.cc:302] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd0126f3631c45fcb11aefb3c17a04bf; no voters:
I20260809 16:19:52.634485 29540 leader_election.cc:288] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:52.634523 29545 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:52.634624 29545 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [term 1 LEADER]: Becoming Leader. State: Replica: cd0126f3631c45fcb11aefb3c17a04bf, State: Running, Role: LEADER
I20260809 16:19:52.634739 29540 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:52.634768 29545 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0126f3631c45fcb11aefb3c17a04bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41359 } }
I20260809 16:19:52.635138 29545 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd0126f3631c45fcb11aefb3c17a04bf. Latest consensus state: current_term: 1 leader_uuid: "cd0126f3631c45fcb11aefb3c17a04bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0126f3631c45fcb11aefb3c17a04bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41359 } } }
I20260809 16:19:52.635288 29545 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:52.635151 29547 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd0126f3631c45fcb11aefb3c17a04bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0126f3631c45fcb11aefb3c17a04bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41359 } } }
I20260809 16:19:52.635432 29547 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:52.635623 29559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:52.636204 29559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:52.637784 29559 catalog_manager.cc:1347] Generated new cluster ID: bc455c55a97f4d729268075cbe41b622
I20260809 16:19:52.637830 29559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:19:52 dist-test-slave-nj21 krb5kdc[29406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 16:19:52.643009 29544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:52.632472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:39285 (local address 127.0.0.1:41359)
0809 16:19:52.632638 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:52.632646 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:52.632671 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:19:52.632931 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:52.632937 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:52.632981 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:52.633088 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:52.633888 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:52.635010 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:52.636079 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:52.636662 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:52.636781 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:52.639549 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:52.639552 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:52.639553 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:52.639564 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:52.641407 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:52.641833 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:52.641835 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:52.641836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:52.641952 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:52.642169 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:52.642169 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:52.642170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:52.642453 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:52.642584 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:52.642718 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 16:19:52.642814 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260809 16:19:52.644006 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:52.652227 29544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:52.645451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:39609 (local address 127.0.0.1:41359)
0809 16:19:52.645486 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:52.645488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:52.645576 (+ 88us) server_negotiation.cc:407] Connection header received
0809 16:19:52.645615 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:52.645616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:52.645626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:52.645678 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:52.646223 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:52.647000 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:52.647993 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:52.648320 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:52.648381 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:52.649646 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:52.649648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:52.649648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:52.649655 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:52.651123 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:52.651504 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:52.651505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:52.651505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:52.651561 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:52.651758 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:52.651759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:52.651759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:52.651882 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:52.651989 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:52.652078 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 16:19:52.652138 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:19:52.657722 29559 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:52.658212 29559 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:52.668758 29559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd0126f3631c45fcb11aefb3c17a04bf: Generated new TSK 0
I20260809 16:19:52.668934 29559 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:52.675424 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29424
W20260809 16:19:52.689206 29402 connection.cc:535] client connection to 127.0.0.1:41359 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41359): Connection reset by peer (error 104)
2026-08-09T16:19:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:52 dist-test-slave-nj21 krb5kdc[29586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:52 dist-test-slave-nj21 krb5kdc[29586](info): set up 2 sockets
Aug 09 16:19:52 dist-test-slave-nj21 krb5kdc[29586](info): commencing operation
krb5kdc: starting...
W20260809 16:19:53.825824 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:53 dist-test-slave-nj21 krb5kdc[29586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:53.938278 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45393
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:54.016574 29600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:54.016764 29600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:54.016784 29600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:54.017845 29600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:54.017877 29600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:54.017890 29600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:54.017901 29600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:54.017911 29600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:54.019321 29600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:54.019522 29600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:54.019703 29600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:54.024087 29606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:54.024109 29608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:54.024132 29600 server_base.cc:1034] running on GCE node
W20260809 16:19:54.024088 29605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:54.024544 29600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:54.024824 29600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:54.025964 29600 hybrid_clock.cc:648] HybridClock initialized: now 1786292394025947 us; error 29 us; skew 500 ppm
Aug 09 16:19:54 dist-test-slave-nj21 krb5kdc[29586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292394, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:54.028291 29600 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:54.028671 29600 webserver.cc:460] Webserver started at http://127.0.0.1:39573/ using document root <none> and password file <none>
I20260809 16:19:54.028832 29600 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:54.028868 29600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:54.028957 29600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:54.029894 29600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971"
format_stamp: "Formatted at 2026-08-09 16:19:54 on dist-test-slave-nj21"
server_key: "a314763772b77a81c5bfddc6b5338e17"
server_key_iv: "1625e0e100c7f7dec4f0fc994fa07804"
server_key_version: "encryptionkey@0"
I20260809 16:19:54.030172 29600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971"
format_stamp: "Formatted at 2026-08-09 16:19:54 on dist-test-slave-nj21"
server_key: "a314763772b77a81c5bfddc6b5338e17"
server_key_iv: "1625e0e100c7f7dec4f0fc994fa07804"
server_key_version: "encryptionkey@0"
I20260809 16:19:54.031292 29600 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:19:54.031965 29617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:54.032122 29600 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:54.032208 29600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971"
format_stamp: "Formatted at 2026-08-09 16:19:54 on dist-test-slave-nj21"
server_key: "a314763772b77a81c5bfddc6b5338e17"
server_key_iv: "1625e0e100c7f7dec4f0fc994fa07804"
server_key_version: "encryptionkey@0"
I20260809 16:19:54.032272 29600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:54.059039 29600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:54.061074 29600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:54.061198 29600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:54.064903 29600 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45393
I20260809 16:19:54.064947 29708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45393 every 8 connection(s)
I20260809 16:19:54.065245 29600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:54.066102 29709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:54.068557 29709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971: Bootstrap starting.
I20260809 16:19:54.069142 29709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:54.069504 29709 log.cc:824] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:54.070261 29709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971: No bootstrap required, opened a new log
I20260809 16:19:54.071905 29709 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45393 } }
I20260809 16:19:54.072045 29709 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:54.072081 29709 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50efa0ca2d3e4b7aac89f4e60a0c1971, State: Initialized, Role: FOLLOWER
I20260809 16:19:54.072225 29709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45393 } }
I20260809 16:19:54.072295 29709 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:54.072356 29709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:54.072412 29709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:54.072523 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29600
I20260809 16:19:54.072623 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:54.072786 28516 external_mini_cluster.cc:1428] Setting key 893e5c1d589d50abef95f7ec9f19a43d
I20260809 16:19:54.073051 29709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45393 } }
I20260809 16:19:54.073168 29709 leader_election.cc:302] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50efa0ca2d3e4b7aac89f4e60a0c1971; no voters:
I20260809 16:19:54.073362 29709 leader_election.cc:288] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:54.073402 29717 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:54.073625 29717 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [term 1 LEADER]: Becoming Leader. State: Replica: 50efa0ca2d3e4b7aac89f4e60a0c1971, State: Running, Role: LEADER
I20260809 16:19:54.073729 29709 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:54.073716 29717 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45393 } }
I20260809 16:19:54.074203 29719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45393 } } }
I20260809 16:19:54.074302 29719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:54.074210 29720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50efa0ca2d3e4b7aac89f4e60a0c1971. Latest consensus state: current_term: 1 leader_uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50efa0ca2d3e4b7aac89f4e60a0c1971" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45393 } } }
I20260809 16:19:54.074522 29720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:54.075093 29722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:54.075536 29722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:54.077102 29722 catalog_manager.cc:1347] Generated new cluster ID: 3be8c2aa332b4d0fae130c7699b43610
I20260809 16:19:54.077153 29722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:54.078693 29718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:54.073255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:48031 (local address 127.0.0.1:45393)
0809 16:19:54.073454 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:54.073464 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:54.073527 (+ 63us) server_negotiation.cc:407] Connection header received
0809 16:19:54.073658 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:54.073665 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:54.073724 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:54.074126 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:54.074325 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:54.075707 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:54.076657 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:54.077187 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:54.077318 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:54.078014 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:54.078017 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:54.078018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:54.078220 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:54.078255 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:54.078268 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:54.078341 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:54.078466 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 16:19:54.078492 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
I20260809 16:19:54.079641 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:54.084676 29718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:54.081087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:56859 (local address 127.0.0.1:45393)
0809 16:19:54.081128 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:54.081130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:54.081252 (+ 122us) server_negotiation.cc:407] Connection header received
0809 16:19:54.081297 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:54.081298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:54.081308 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:54.081379 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:54.081504 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:54.082474 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:54.083417 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:54.083740 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:54.083811 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:54.084437 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:54.084439 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:54.084439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:54.084445 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:54.084460 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:54.084465 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:54.084535 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:54.084594 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 16:19:54.084606 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:19:54.090399 29722 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:54.091076 29722 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:54.094600 29722 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50efa0ca2d3e4b7aac89f4e60a0c1971: Generated new TSK 0
I20260809 16:19:54.094749 29722 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:54.104470 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29600
W20260809 16:19:54.120814 29584 connection.cc:535] client connection to 127.0.0.1:45393 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45393): Connection reset by peer (error 104)
2026-08-09T16:19:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:54 dist-test-slave-nj21 krb5kdc[29746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:54 dist-test-slave-nj21 krb5kdc[29746](info): set up 2 sockets
Aug 09 16:19:54 dist-test-slave-nj21 krb5kdc[29746](info): commencing operation
krb5kdc: starting...
W20260809 16:19:55.239218 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:55 dist-test-slave-nj21 krb5kdc[29746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:55.350052 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38747
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:55.429524 29768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:55.429708 29768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:55.429728 29768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:55.430826 29768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:55.430867 29768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:55.430879 29768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:55.430902 29768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:55.430927 29768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:55.432390 29768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38747
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:55.432610 29768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:55.432816 29768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:55.437202 29778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:55.437211 29780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:55.437222 29777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:55.437417 29768 server_base.cc:1034] running on GCE node
I20260809 16:19:55.437661 29768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:55.437937 29768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:55.439085 29768 hybrid_clock.cc:648] HybridClock initialized: now 1786292395439074 us; error 26 us; skew 500 ppm
Aug 09 16:19:55 dist-test-slave-nj21 krb5kdc[29746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292395, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:55.444650 29768 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:55.445086 29768 webserver.cc:460] Webserver started at http://127.0.0.1:37851/ using document root <none> and password file <none>
I20260809 16:19:55.445287 29768 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:55.445334 29768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:55.445462 29768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:55.446461 29768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "923d3cd88d1f4aaebb28baa1dc055019"
format_stamp: "Formatted at 2026-08-09 16:19:55 on dist-test-slave-nj21"
server_key: "529d33c397eec2c52d3ce525e72331b6"
server_key_iv: "594c7b0d73a87c43c57920b3dff4f0cf"
server_key_version: "encryptionkey@0"
I20260809 16:19:55.446784 29768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "923d3cd88d1f4aaebb28baa1dc055019"
format_stamp: "Formatted at 2026-08-09 16:19:55 on dist-test-slave-nj21"
server_key: "529d33c397eec2c52d3ce525e72331b6"
server_key_iv: "594c7b0d73a87c43c57920b3dff4f0cf"
server_key_version: "encryptionkey@0"
I20260809 16:19:55.448019 29768 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 16:19:55.448645 29791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:55.448789 29768 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:19:55.448872 29768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "923d3cd88d1f4aaebb28baa1dc055019"
format_stamp: "Formatted at 2026-08-09 16:19:55 on dist-test-slave-nj21"
server_key: "529d33c397eec2c52d3ce525e72331b6"
server_key_iv: "594c7b0d73a87c43c57920b3dff4f0cf"
server_key_version: "encryptionkey@0"
I20260809 16:19:55.448928 29768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:55.452064 29768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:55.453668 29768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:55.453789 29768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:55.457590 29768 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38747
I20260809 16:19:55.457617 29874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38747 every 8 connection(s)
I20260809 16:19:55.457902 29768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:55.458779 29876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:55.460922 29876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019: Bootstrap starting.
I20260809 16:19:55.461436 29876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:55.461658 29876 log.cc:824] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:55.462231 29876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019: No bootstrap required, opened a new log
I20260809 16:19:55.463757 29876 raft_consensus.cc:348] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923d3cd88d1f4aaebb28baa1dc055019" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } }
I20260809 16:19:55.463886 29876 raft_consensus.cc:374] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:55.463912 29876 raft_consensus.cc:729] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 923d3cd88d1f4aaebb28baa1dc055019, State: Initialized, Role: FOLLOWER
I20260809 16:19:55.464007 29876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923d3cd88d1f4aaebb28baa1dc055019" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } }
I20260809 16:19:55.464054 29876 raft_consensus.cc:388] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:55.464073 29876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:55.464102 29876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:55.464298 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29768
I20260809 16:19:55.464414 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:55.464589 28516 external_mini_cluster.cc:1428] Setting key 78b719e9bdc4e8ef0716cf0fcd091b9c
I20260809 16:19:55.464732 29876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923d3cd88d1f4aaebb28baa1dc055019" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } }
I20260809 16:19:55.464824 29876 leader_election.cc:302] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 923d3cd88d1f4aaebb28baa1dc055019; no voters:
I20260809 16:19:55.464969 29876 leader_election.cc:288] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:55.465006 29880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:55.465191 29880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [term 1 LEADER]: Becoming Leader. State: Replica: 923d3cd88d1f4aaebb28baa1dc055019, State: Running, Role: LEADER
I20260809 16:19:55.465224 29876 sys_catalog.cc:564] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:55.465328 29880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923d3cd88d1f4aaebb28baa1dc055019" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } }
I20260809 16:19:55.465615 29880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "923d3cd88d1f4aaebb28baa1dc055019" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923d3cd88d1f4aaebb28baa1dc055019" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } } }
I20260809 16:19:55.465680 29880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:55.465778 29880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 923d3cd88d1f4aaebb28baa1dc055019. Latest consensus state: current_term: 1 leader_uuid: "923d3cd88d1f4aaebb28baa1dc055019" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "923d3cd88d1f4aaebb28baa1dc055019" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } } }
I20260809 16:19:55.465813 29880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:55.466150 29888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:55.466892 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:55.465167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:48281 (local address 127.0.0.1:38747)
0809 16:19:55.465340 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:55.465348 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:55.465375 (+ 27us) server_negotiation.cc:407] Connection header received
0809 16:19:55.465471 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:55.465476 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:55.465498 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:55.465609 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:55.466323 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:55.466327 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:55.466327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:55.466333 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:55.466379 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:55.466394 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:55.466467 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:55.466654 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 16:19:55.466706 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260809 16:19:55.467260 29888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:55.467990 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:55.468654 29888 catalog_manager.cc:1347] Generated new cluster ID: c9b476d845ed45a7bd9aa35f03a5dd82
I20260809 16:19:55.468700 29888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:55.472627 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:55.471734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:53509 (local address 127.0.0.1:38747)
0809 16:19:55.471767 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:55.471769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:55.471777 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:19:55.471794 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:55.471795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:55.471799 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:55.471851 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:55.472415 (+ 564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:55.472416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:55.472416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:55.472420 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:55.472434 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:55.472438 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:55.472484 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:55.472556 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 16:19:55.472568 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:19:55.486992 29888 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:55.487140 29888 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:55.494452 29888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 923d3cd88d1f4aaebb28baa1dc055019: Generated new TSK 0
I20260809 16:19:55.494613 29888 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:55.498260 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29768
2026-08-09T16:19:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1396 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:55 dist-test-slave-nj21 krb5kdc[29916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:55 dist-test-slave-nj21 krb5kdc[29916](info): set up 2 sockets
Aug 09 16:19:55 dist-test-slave-nj21 krb5kdc[29916](info): commencing operation
krb5kdc: starting...
W20260809 16:19:56.656597 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:56 dist-test-slave-nj21 krb5kdc[29916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:56.769747 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45397
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:56.848218 29940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:56.848416 29940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:56.848446 29940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:56.849556 29940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:56.849598 29940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:56.849617 29940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:56.849632 29940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:56.849648 29940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:56.851075 29940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45397
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:56.851305 29940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:56.851500 29940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:56.856040 29952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:56.856093 29947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:56.856112 29948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:56.856266 29940 server_base.cc:1034] running on GCE node
I20260809 16:19:56.856488 29940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:56.856767 29940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:56.857931 29940 hybrid_clock.cc:648] HybridClock initialized: now 1786292396857912 us; error 36 us; skew 500 ppm
Aug 09 16:19:56 dist-test-slave-nj21 krb5kdc[29916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292396, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:56.860358 29940 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:56.860760 29940 webserver.cc:460] Webserver started at http://127.0.0.1:36461/ using document root <none> and password file <none>
I20260809 16:19:56.860951 29940 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:56.860992 29940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:56.861109 29940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:56.862102 29940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "0ab483817b28418483e6a2697fd646e5"
format_stamp: "Formatted at 2026-08-09 16:19:56 on dist-test-slave-nj21"
server_key: "8eb12b8360886345a7abf6b5faa59d88"
server_key_iv: "48d3f05cfb290d1c61e544fa7f6cd5af"
server_key_version: "encryptionkey@0"
I20260809 16:19:56.862426 29940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "0ab483817b28418483e6a2697fd646e5"
format_stamp: "Formatted at 2026-08-09 16:19:56 on dist-test-slave-nj21"
server_key: "8eb12b8360886345a7abf6b5faa59d88"
server_key_iv: "48d3f05cfb290d1c61e544fa7f6cd5af"
server_key_version: "encryptionkey@0"
I20260809 16:19:56.863633 29940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:19:56.864346 29966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:56.864512 29940 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:56.864594 29940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "0ab483817b28418483e6a2697fd646e5"
format_stamp: "Formatted at 2026-08-09 16:19:56 on dist-test-slave-nj21"
server_key: "8eb12b8360886345a7abf6b5faa59d88"
server_key_iv: "48d3f05cfb290d1c61e544fa7f6cd5af"
server_key_version: "encryptionkey@0"
I20260809 16:19:56.864646 29940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:56.882705 29940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:56.884407 29940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:56.884512 29940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:56.888103 29940 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45397
I20260809 16:19:56.888136 30043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45397 every 8 connection(s)
I20260809 16:19:56.888439 29940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:56.889257 30045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:56.891472 30045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5: Bootstrap starting.
I20260809 16:19:56.892067 30045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:56.892318 30045 log.cc:824] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:56.892959 30045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5: No bootstrap required, opened a new log
I20260809 16:19:56.893795 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 29940
I20260809 16:19:56.893895 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:56.894068 28516 external_mini_cluster.cc:1428] Setting key a49b01a94aa2496f8d81dc9fd08fb7a2
I20260809 16:19:56.894760 30045 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab483817b28418483e6a2697fd646e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45397 } }
I20260809 16:19:56.894937 30045 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:56.894981 30045 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab483817b28418483e6a2697fd646e5, State: Initialized, Role: FOLLOWER
I20260809 16:19:56.895105 30045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab483817b28418483e6a2697fd646e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45397 } }
I20260809 16:19:56.895188 30045 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:56.895277 30045 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:56.895334 30045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:56.895912 30045 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab483817b28418483e6a2697fd646e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45397 } }
I20260809 16:19:56.896009 30045 leader_election.cc:302] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ab483817b28418483e6a2697fd646e5; no voters:
I20260809 16:19:56.896164 30045 leader_election.cc:288] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:56.896203 30051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:56.896366 30051 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [term 1 LEADER]: Becoming Leader. State: Replica: 0ab483817b28418483e6a2697fd646e5, State: Running, Role: LEADER
I20260809 16:19:56.896413 30045 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:56.897604 30051 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab483817b28418483e6a2697fd646e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45397 } }
I20260809 16:19:56.898129 30052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ab483817b28418483e6a2697fd646e5. Latest consensus state: current_term: 1 leader_uuid: "0ab483817b28418483e6a2697fd646e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab483817b28418483e6a2697fd646e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45397 } } }
I20260809 16:19:56.898672 30052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [sys.catalog]: This master's current role is: LEADER
W20260809 16:19:56.898679 30078 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:19:56.898756 30078 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:19:56.898169 30053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ab483817b28418483e6a2697fd646e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab483817b28418483e6a2697fd646e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45397 } } }
I20260809 16:19:56.898883 30053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:56.898895 30081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:56.899062 30081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:56.900364 30081 catalog_manager.cc:1347] Generated new cluster ID: 2c6659ff44a44d87b2f0f7adb8542b02
I20260809 16:19:56.900414 30081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 16:19:56 dist-test-slave-nj21 krb5kdc[29916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 16:19:56.904641 30050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:56.894550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:42539 (local address 127.0.0.1:45397)
0809 16:19:56.894749 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:56.894758 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:56.894790 (+ 32us) server_negotiation.cc:407] Connection header received
0809 16:19:56.894898 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:56.894905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:56.894961 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:56.895097 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:56.895764 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:56.896817 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:56.897614 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:56.898144 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:56.898259 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:56.901042 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:56.901046 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:56.901046 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:56.901057 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:56.902948 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:56.903365 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:56.903368 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:56.903368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:56.903500 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:56.903717 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:56.903718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:56.903719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:56.904016 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:56.904183 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:56.904274 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 16:19:56.904400 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":106,"threads_started":1}
I20260809 16:19:56.905601 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:56.915697 30081 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:56.916181 30081 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:56.919329 30081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ab483817b28418483e6a2697fd646e5: Generated new TSK 0
I20260809 16:19:56.919490 30081 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:56.922225 30050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:56.907101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:47755 (local address 127.0.0.1:45397)
0809 16:19:56.907133 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:56.907135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:56.915572 (+ 8437us) server_negotiation.cc:407] Connection header received
0809 16:19:56.915631 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:56.915631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:56.915642 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:56.915735 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:56.916348 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:56.917325 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:56.918356 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:56.918673 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:56.918730 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:56.920014 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:56.920015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:56.920015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:19:56.920022 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:56.921220 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:56.921549 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:56.921550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:56.921551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:56.921600 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:19:56.921783 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:19:56.921784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:19:56.921785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:19:56.921888 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:56.921976 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:56.922089 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 16:19:56.922147 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:19:56.924120 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 29940
W20260809 16:19:56.937829 29912 connection.cc:535] client connection to 127.0.0.1:45397 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45397): Connection reset by peer (error 104)
2026-08-09T16:19:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1420 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:56 dist-test-slave-nj21 krb5kdc[30095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:56 dist-test-slave-nj21 krb5kdc[30095](info): set up 2 sockets
Aug 09 16:19:56 dist-test-slave-nj21 krb5kdc[30095](info): commencing operation
krb5kdc: starting...
W20260809 16:19:58.078117 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:58 dist-test-slave-nj21 krb5kdc[30095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:58.199020 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36011
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:58.280743 30114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:58.280926 30114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:58.280947 30114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:58.282048 30114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:58.282088 30114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:58.282101 30114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:58.282112 30114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:58.282124 30114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:58.283548 30114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36011
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:58.283800 30114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:58.284019 30114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:58.288530 30124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:58.288589 30121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:58.288607 30114 server_base.cc:1034] running on GCE node
W20260809 16:19:58.288527 30120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:58.289012 30114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:58.289283 30114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:58.290428 30114 hybrid_clock.cc:648] HybridClock initialized: now 1786292398290409 us; error 32 us; skew 500 ppm
Aug 09 16:19:58 dist-test-slave-nj21 krb5kdc[30095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292398, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:58.292886 30114 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:58.293299 30114 webserver.cc:460] Webserver started at http://127.0.0.1:45193/ using document root <none> and password file <none>
I20260809 16:19:58.293532 30114 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:58.293583 30114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:58.293681 30114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:58.294674 30114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "ca69a7da68d145d8a7c79b711c924104"
format_stamp: "Formatted at 2026-08-09 16:19:58 on dist-test-slave-nj21"
server_key: "0eee564b2db61e203481dad7dc92bb1d"
server_key_iv: "bdf68b016c9a60186b2530b5a3849948"
server_key_version: "encryptionkey@0"
I20260809 16:19:58.294982 30114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "ca69a7da68d145d8a7c79b711c924104"
format_stamp: "Formatted at 2026-08-09 16:19:58 on dist-test-slave-nj21"
server_key: "0eee564b2db61e203481dad7dc92bb1d"
server_key_iv: "bdf68b016c9a60186b2530b5a3849948"
server_key_version: "encryptionkey@0"
I20260809 16:19:58.296291 30114 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 16:19:58.297025 30135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:58.297178 30114 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:58.297266 30114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "ca69a7da68d145d8a7c79b711c924104"
format_stamp: "Formatted at 2026-08-09 16:19:58 on dist-test-slave-nj21"
server_key: "0eee564b2db61e203481dad7dc92bb1d"
server_key_iv: "bdf68b016c9a60186b2530b5a3849948"
server_key_version: "encryptionkey@0"
I20260809 16:19:58.297325 30114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:58.316324 30114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:58.318380 30114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:58.318516 30114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:58.322324 30114 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36011
I20260809 16:19:58.322362 30226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36011 every 8 connection(s)
I20260809 16:19:58.322676 30114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:58.323535 30227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:58.323834 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30114
I20260809 16:19:58.323948 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:58.324123 28516 external_mini_cluster.cc:1428] Setting key 24c47c61079c340a1eabf0fdf6b89137
I20260809 16:19:58.326123 30227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104: Bootstrap starting.
I20260809 16:19:58.326727 30227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:58.327037 30227 log.cc:824] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:58.327754 30227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104: No bootstrap required, opened a new log
I20260809 16:19:58.329301 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:58.324622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:33475 (local address 127.0.0.1:36011)
0809 16:19:58.324778 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:58.324785 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:58.324810 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:19:58.325209 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:58.325215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:58.325261 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:58.325379 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:58.325625 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:58.326511 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:58.327535 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:58.327997 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:58.328076 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:58.328712 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:58.328716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:58.328716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:58.328875 (+ 159us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:58.328903 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:58.328913 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:58.328974 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:58.329078 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 16:19:58.329101 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260809 16:19:58.329913 30227 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca69a7da68d145d8a7c79b711c924104" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } }
I20260809 16:19:58.330066 30227 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:58.330098 30227 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca69a7da68d145d8a7c79b711c924104, State: Initialized, Role: FOLLOWER
I20260809 16:19:58.330195 30227 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca69a7da68d145d8a7c79b711c924104" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } }
I20260809 16:19:58.330253 30227 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:58.330263 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:58.330281 30227 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:58.330329 30227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:58.330833 30227 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca69a7da68d145d8a7c79b711c924104" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } }
I20260809 16:19:58.330927 30227 leader_election.cc:302] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca69a7da68d145d8a7c79b711c924104; no voters:
I20260809 16:19:58.331099 30227 leader_election.cc:288] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:58.331138 30232 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:58.331254 30232 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [term 1 LEADER]: Becoming Leader. State: Replica: ca69a7da68d145d8a7c79b711c924104, State: Running, Role: LEADER
I20260809 16:19:58.331346 30227 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:58.331393 30232 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca69a7da68d145d8a7c79b711c924104" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } }
I20260809 16:19:58.331760 30239 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca69a7da68d145d8a7c79b711c924104" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca69a7da68d145d8a7c79b711c924104" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } } }
I20260809 16:19:58.331840 30239 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:58.331985 30239 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca69a7da68d145d8a7c79b711c924104. Latest consensus state: current_term: 1 leader_uuid: "ca69a7da68d145d8a7c79b711c924104" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca69a7da68d145d8a7c79b711c924104" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } } }
I20260809 16:19:58.332041 30239 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104 [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:58.332059 30247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:58.332541 30247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:58.334164 30247 catalog_manager.cc:1347] Generated new cluster ID: 850d79d5d78d4149b7732b5b0f6192f3
I20260809 16:19:58.334218 30247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:58.335532 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:58.331651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:38123 (local address 127.0.0.1:36011)
0809 16:19:58.331714 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:58.331715 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:58.332506 (+ 791us) server_negotiation.cc:407] Connection header received
0809 16:19:58.332624 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:58.332625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:58.332636 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:58.332667 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:58.332885 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:58.333536 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:58.334398 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:19:58.334628 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:19:58.334685 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:19:58.335299 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:58.335300 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:58.335300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:58.335304 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:58.335319 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:58.335323 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:58.335393 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:58.335451 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 16:19:58.335460 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 16:19:58.355296 30247 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:58.355832 30247 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:58.362454 30247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca69a7da68d145d8a7c79b711c924104: Generated new TSK 0
I20260809 16:19:58.362607 30247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:58.372251 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30114
W20260809 16:19:58.384006 30093 connection.cc:535] client connection to 127.0.0.1:36011 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36011): Connection reset by peer (error 104)
2026-08-09T16:19:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1446 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:58 dist-test-slave-nj21 krb5kdc[30269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:58 dist-test-slave-nj21 krb5kdc[30269](info): set up 2 sockets
Aug 09 16:19:58 dist-test-slave-nj21 krb5kdc[30269](info): commencing operation
krb5kdc: starting...
W20260809 16:19:59.510812 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:19:59 dist-test-slave-nj21 krb5kdc[30269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:19:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:19:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 16:19:59.623993 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39071
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:19:59.707149 30290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:19:59.707338 30290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:19:59.707369 30290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:19:59.708532 30290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:19:59.708575 30290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:19:59.708593 30290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:19:59.708608 30290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:19:59.708623 30290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:19:59.710108 30290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39071
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:19:59.710342 30290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:19:59.710544 30290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:19:59.715056 30300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:59.715031 30296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:19:59.715034 30302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:19:59.715274 30290 server_base.cc:1034] running on GCE node
I20260809 16:19:59.715508 30290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:19:59.715824 30290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:19:59.716967 30290 hybrid_clock.cc:648] HybridClock initialized: now 1786292399716956 us; error 29 us; skew 500 ppm
Aug 09 16:19:59 dist-test-slave-nj21 krb5kdc[30269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292399, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:19:59.719343 30290 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 16:19:59.719822 30290 webserver.cc:460] Webserver started at http://127.0.0.1:33051/ using document root <none> and password file <none>
I20260809 16:19:59.720044 30290 fs_manager.cc:359] Metadata directory not provided
I20260809 16:19:59.720090 30290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:19:59.720217 30290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:19:59.721182 30290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "20d7df191a5f472a875461f61ddd739b"
format_stamp: "Formatted at 2026-08-09 16:19:59 on dist-test-slave-nj21"
server_key: "675970f8509c0c3c191fd42128e3477a"
server_key_iv: "7cd68006eaa2d1aadac392ca88d00db2"
server_key_version: "encryptionkey@0"
I20260809 16:19:59.721514 30290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "20d7df191a5f472a875461f61ddd739b"
format_stamp: "Formatted at 2026-08-09 16:19:59 on dist-test-slave-nj21"
server_key: "675970f8509c0c3c191fd42128e3477a"
server_key_iv: "7cd68006eaa2d1aadac392ca88d00db2"
server_key_version: "encryptionkey@0"
I20260809 16:19:59.722743 30290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:19:59.723384 30315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:19:59.723548 30290 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:19:59.723634 30290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "20d7df191a5f472a875461f61ddd739b"
format_stamp: "Formatted at 2026-08-09 16:19:59 on dist-test-slave-nj21"
server_key: "675970f8509c0c3c191fd42128e3477a"
server_key_iv: "7cd68006eaa2d1aadac392ca88d00db2"
server_key_version: "encryptionkey@0"
I20260809 16:19:59.723726 30290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:19:59.726825 30290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:19:59.728787 30290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:19:59.728929 30290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:19:59.732942 30290 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39071
I20260809 16:19:59.732978 30395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39071 every 8 connection(s)
I20260809 16:19:59.733290 30290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:19:59.734262 30396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:19:59.736492 30396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b: Bootstrap starting.
I20260809 16:19:59.737087 30396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b: Neither blocks nor log segments found. Creating new log.
I20260809 16:19:59.737407 30396 log.cc:824] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b: Log is configured to *not* fsync() on all Append() calls
I20260809 16:19:59.738024 30396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b: No bootstrap required, opened a new log
I20260809 16:19:59.739553 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30290
I20260809 16:19:59.739537 30396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20d7df191a5f472a875461f61ddd739b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } }
I20260809 16:19:59.739651 30396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:19:59.739663 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:19:59.739781 30396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20d7df191a5f472a875461f61ddd739b, State: Initialized, Role: FOLLOWER
I20260809 16:19:59.739866 28516 external_mini_cluster.cc:1428] Setting key 4d735ad27ab626163335fe0b02c96d50
I20260809 16:19:59.739946 30396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20d7df191a5f472a875461f61ddd739b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } }
I20260809 16:19:59.740041 30396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:19:59.740080 30396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:19:59.740124 30396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:19:59.741325 30396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20d7df191a5f472a875461f61ddd739b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } }
I20260809 16:19:59.741428 30396 leader_election.cc:302] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20d7df191a5f472a875461f61ddd739b; no voters:
I20260809 16:19:59.741572 30396 leader_election.cc:288] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:19:59.741611 30405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:19:59.741755 30405 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [term 1 LEADER]: Becoming Leader. State: Replica: 20d7df191a5f472a875461f61ddd739b, State: Running, Role: LEADER
I20260809 16:19:59.741875 30396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:19:59.741879 30405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20d7df191a5f472a875461f61ddd739b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } }
I20260809 16:19:59.742254 30403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:59.740328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:46263 (local address 127.0.0.1:39071)
0809 16:19:59.740518 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:59.740540 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:59.740609 (+ 69us) server_negotiation.cc:407] Connection header received
0809 16:19:59.740908 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:59.740917 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:59.740950 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:59.741090 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:59.741640 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:59.741643 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:59.741643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:59.741648 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:59.741699 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:59.741715 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:59.741993 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:59.742025 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 16:19:59.742068 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260809 16:19:59.742275 30407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20d7df191a5f472a875461f61ddd739b. Latest consensus state: current_term: 1 leader_uuid: "20d7df191a5f472a875461f61ddd739b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20d7df191a5f472a875461f61ddd739b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } } }
I20260809 16:19:59.742483 30407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:59.742352 30406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20d7df191a5f472a875461f61ddd739b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20d7df191a5f472a875461f61ddd739b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } } }
I20260809 16:19:59.742561 30406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b [sys.catalog]: This master's current role is: LEADER
I20260809 16:19:59.742851 30418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:19:59.743324 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:19:59.743409 30418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:19:59.745242 30418 catalog_manager.cc:1347] Generated new cluster ID: f39656311acd467eb7e31a55a2929c6e
I20260809 16:19:59.745289 30418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:19:59.745766 30403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:19:59.744846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.99:44413 (local address 127.0.0.1:39071)
0809 16:19:59.744880 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 16:19:59.744881 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:19:59.744977 (+ 96us) server_negotiation.cc:407] Connection header received
0809 16:19:59.745022 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:19:59.745023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:19:59.745028 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:19:59.745087 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:19:59.745602 (+ 515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:19:59.745603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:19:59.745603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:19:59.745607 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:19:59.745618 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:19:59.745622 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:19:59.745660 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 16:19:59.745699 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 16:19:59.745708 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:19:59.766022 30418 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:19:59.766180 30418 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:19:59.771482 30418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20d7df191a5f472a875461f61ddd739b: Generated new TSK 0
I20260809 16:19:59.771631 30418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:19:59.777666 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30290
2026-08-09T16:19:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1405 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:19:59 dist-test-slave-nj21 krb5kdc[30446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:19:59 dist-test-slave-nj21 krb5kdc[30446](info): set up 2 sockets
Aug 09 16:19:59 dist-test-slave-nj21 krb5kdc[30446](info): commencing operation
krb5kdc: starting...
W20260809 16:20:00.923214 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:20:01 dist-test-slave-nj21 krb5kdc[30446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:20:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:20:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:20:01.038882 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:34231
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:34231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:20:01.119606 30462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:01.119855 30462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:01.119879 30462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:01.121027 30462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:01.121069 30462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:01.121083 30462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:01.121094 30462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:01.121117 30462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:01.122599 30462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:34231
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:34231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:01.122834 30462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:01.123045 30462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:01.127609 30472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:01.127748 30462 server_base.cc:1034] running on GCE node
W20260809 16:20:01.127615 30467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:01.127615 30468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:01.128108 30462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:01.128397 30462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:01.129580 30462 hybrid_clock.cc:648] HybridClock initialized: now 1786292401129557 us; error 28 us; skew 500 ppm
Aug 09 16:20:01 dist-test-slave-nj21 krb5kdc[30446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292401, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:01.134547 30462 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:20:01.135017 30462 webserver.cc:460] Webserver started at http://127.27.217.62:39867/ using document root <none> and password file <none>
I20260809 16:20:01.135218 30462 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:01.135267 30462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:01.135396 30462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:01.136502 30462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "9f5cb651684b40f79069e0af33ab0d0c"
format_stamp: "Formatted at 2026-08-09 16:20:01 on dist-test-slave-nj21"
server_key: "fbfa5006bb4dde143d2d27f912c9c4fc"
server_key_iv: "0f12b84d09f8ca539082251d8c0c82d0"
server_key_version: "encryptionkey@0"
I20260809 16:20:01.136844 30462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "9f5cb651684b40f79069e0af33ab0d0c"
format_stamp: "Formatted at 2026-08-09 16:20:01 on dist-test-slave-nj21"
server_key: "fbfa5006bb4dde143d2d27f912c9c4fc"
server_key_iv: "0f12b84d09f8ca539082251d8c0c82d0"
server_key_version: "encryptionkey@0"
I20260809 16:20:01.138106 30462 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:20:01.138763 30484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:01.138913 30462 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:20:01.139005 30462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "9f5cb651684b40f79069e0af33ab0d0c"
format_stamp: "Formatted at 2026-08-09 16:20:01 on dist-test-slave-nj21"
server_key: "fbfa5006bb4dde143d2d27f912c9c4fc"
server_key_iv: "0f12b84d09f8ca539082251d8c0c82d0"
server_key_version: "encryptionkey@0"
I20260809 16:20:01.139061 30462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:01.154376 30462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:01.156527 30462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:01.156670 30462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:01.160625 30462 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:34231
I20260809 16:20:01.160661 30561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:34231 every 8 connection(s)
I20260809 16:20:01.160981 30462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:20:01.161787 30564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:01.163424 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30462
I20260809 16:20:01.163542 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:20:01.163754 28516 external_mini_cluster.cc:1428] Setting key d1d07a2c9167f43e17070dd338e3eed6
I20260809 16:20:01.164348 30564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c: Bootstrap starting.
I20260809 16:20:01.164923 30564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:01.165236 30564 log.cc:824] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:01.165948 30564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c: No bootstrap required, opened a new log
I20260809 16:20:01.167979 30564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cb651684b40f79069e0af33ab0d0c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 34231 } }
I20260809 16:20:01.168108 30564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:20:01.168129 30564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5cb651684b40f79069e0af33ab0d0c, State: Initialized, Role: FOLLOWER
I20260809 16:20:01.168257 30564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cb651684b40f79069e0af33ab0d0c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 34231 } }
I20260809 16:20:01.168326 30564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:20:01.168357 30564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:20:01.168442 30564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:01.168936 30564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cb651684b40f79069e0af33ab0d0c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 34231 } }
I20260809 16:20:01.169030 30564 leader_election.cc:302] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f5cb651684b40f79069e0af33ab0d0c; no voters:
I20260809 16:20:01.169170 30564 leader_election.cc:288] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:20:01.169204 30569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:20:01.169313 30569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [term 1 LEADER]: Becoming Leader. State: Replica: 9f5cb651684b40f79069e0af33ab0d0c, State: Running, Role: LEADER
I20260809 16:20:01.169464 30564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:01.169463 30569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cb651684b40f79069e0af33ab0d0c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 34231 } }
I20260809 16:20:01.169919 30569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f5cb651684b40f79069e0af33ab0d0c. Latest consensus state: current_term: 1 leader_uuid: "9f5cb651684b40f79069e0af33ab0d0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cb651684b40f79069e0af33ab0d0c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 34231 } } }
I20260809 16:20:01.169924 30570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f5cb651684b40f79069e0af33ab0d0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cb651684b40f79069e0af33ab0d0c" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 34231 } } }
I20260809 16:20:01.170077 30569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:01.170158 30570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c [sys.catalog]: This master's current role is: LEADER
Aug 09 16:20:01 dist-test-slave-nj21 krb5kdc[30446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:20:01.170733 30582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:20:01.171442 30582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:20:01.174258 30567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:01.164265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35227 (local address 127.27.217.62:34231)
0809 16:20:01.164437 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:01.164447 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:01.164480 (+ 33us) server_negotiation.cc:407] Connection header received
0809 16:20:01.164908 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:01.164914 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:01.164972 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:01.165110 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:01.165804 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:01.166708 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:01.167801 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:01.168227 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:01.168334 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:01.171055 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:01.171059 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:01.171060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:01.171071 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:01.172777 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:01.173210 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:01.173212 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:01.173212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:01.173287 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:01.173504 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:01.173504 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:01.173505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:01.173713 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:01.173807 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:01.173991 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 16:20:01.174066 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260809 16:20:01.175218 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:20:01.180092 30582 catalog_manager.cc:1347] Generated new cluster ID: e5e11bb9365e496ba0d4e0be01923565
I20260809 16:20:01.180158 30582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:20:01.185694 30567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:01.176517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50219 (local address 127.27.217.62:34231)
0809 16:20:01.176548 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:01.176550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:01.180166 (+ 3616us) server_negotiation.cc:407] Connection header received
0809 16:20:01.180280 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:01.180281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:01.180292 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:01.180337 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:01.180872 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:01.181349 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:01.181998 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:01.182196 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:01.182249 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:01.183456 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:01.183458 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:01.183458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:01.183464 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:01.184661 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:01.184986 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:01.184987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:01.184988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:01.185035 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:01.185219 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:01.185219 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:01.185220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:01.185315 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:01.185420 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:01.185554 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 16:20:01.185610 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260809 16:20:01.200088 30582 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:20:01.200809 30582 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:20:01.210443 30582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f5cb651684b40f79069e0af33ab0d0c: Generated new TSK 0
I20260809 16:20:01.210646 30582 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:20:01.213934 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30462
W20260809 16:20:01.231609 30443 connection.cc:535] client connection to 127.27.217.62:34231 recv error: Network error: failed to read from TLS socket (remote: 127.27.217.62:34231): Connection reset by peer (error 104)
2026-08-09T16:20:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:20:01 dist-test-slave-nj21 krb5kdc[30604](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:20:01 dist-test-slave-nj21 krb5kdc[30604](info): set up 2 sockets
Aug 09 16:20:01 dist-test-slave-nj21 krb5kdc[30604](info): commencing operation
krb5kdc: starting...
W20260809 16:20:02.368228 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:20:02 dist-test-slave-nj21 krb5kdc[30604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:20:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:20:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:20:02.482653 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35553
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:40965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:35553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:20:02.561631 30625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:02.561836 30625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:02.561864 30625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:02.563040 30625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:02.563086 30625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:02.563103 30625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:02.563122 30625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:02.563136 30625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:02.564643 30625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:40965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:35553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:02.564891 30625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:02.565105 30625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:02.569726 30636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:02.569707 30637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:02.569733 30625 server_base.cc:1034] running on GCE node
W20260809 16:20:02.569708 30639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:02.570118 30625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:02.570380 30625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:02.571521 30625 hybrid_clock.cc:648] HybridClock initialized: now 1786292402571507 us; error 29 us; skew 500 ppm
Aug 09 16:20:02 dist-test-slave-nj21 krb5kdc[30604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292402, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:02.573906 30625 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:20:02.574318 30625 webserver.cc:460] Webserver started at http://127.27.217.62:40773/ using document root <none> and password file <none>
I20260809 16:20:02.574517 30625 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:02.574563 30625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:02.574689 30625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:02.575757 30625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "d5e5dc0bfb464ace88594c818ac0a844"
format_stamp: "Formatted at 2026-08-09 16:20:02 on dist-test-slave-nj21"
server_key: "c8ecafe643a2419edf956f74c2de9bc2"
server_key_iv: "0820d505847a108e5e87848aed14bcf6"
server_key_version: "encryptionkey@0"
I20260809 16:20:02.576098 30625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "d5e5dc0bfb464ace88594c818ac0a844"
format_stamp: "Formatted at 2026-08-09 16:20:02 on dist-test-slave-nj21"
server_key: "c8ecafe643a2419edf956f74c2de9bc2"
server_key_iv: "0820d505847a108e5e87848aed14bcf6"
server_key_version: "encryptionkey@0"
I20260809 16:20:02.577420 30625 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:20:02.578084 30649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:02.578226 30625 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:20:02.578312 30625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "d5e5dc0bfb464ace88594c818ac0a844"
format_stamp: "Formatted at 2026-08-09 16:20:02 on dist-test-slave-nj21"
server_key: "c8ecafe643a2419edf956f74c2de9bc2"
server_key_iv: "0820d505847a108e5e87848aed14bcf6"
server_key_version: "encryptionkey@0"
I20260809 16:20:02.578370 30625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:02.596808 30625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:02.598834 30625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:02.598973 30625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:02.602725 30625 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:35553
I20260809 16:20:02.602766 30726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:35553 every 8 connection(s)
I20260809 16:20:02.603073 30625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:20:02.603899 30727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:02.606137 30727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844: Bootstrap starting.
I20260809 16:20:02.606699 30727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:02.606961 30727 log.cc:824] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:02.607007 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30625
I20260809 16:20:02.607117 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:20:02.607270 28516 external_mini_cluster.cc:1428] Setting key e2c685cc69886bb4f5bf455ee8f4b1e8
I20260809 16:20:02.607666 30727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844: No bootstrap required, opened a new log
I20260809 16:20:02.609946 30727 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e5dc0bfb464ace88594c818ac0a844" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35553 } }
I20260809 16:20:02.610113 30727 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:20:02.610154 30727 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5e5dc0bfb464ace88594c818ac0a844, State: Initialized, Role: FOLLOWER
I20260809 16:20:02.610292 30727 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e5dc0bfb464ace88594c818ac0a844" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35553 } }
I20260809 16:20:02.610407 30727 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:20:02.610461 30727 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:20:02.610512 30727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:02.611214 30727 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e5dc0bfb464ace88594c818ac0a844" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35553 } }
I20260809 16:20:02.611335 30727 leader_election.cc:302] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5e5dc0bfb464ace88594c818ac0a844; no voters:
I20260809 16:20:02.611492 30727 leader_election.cc:288] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:20:02.611526 30733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:20:02.611727 30733 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [term 1 LEADER]: Becoming Leader. State: Replica: d5e5dc0bfb464ace88594c818ac0a844, State: Running, Role: LEADER
I20260809 16:20:02.611763 30727 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:02.611819 30733 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e5dc0bfb464ace88594c818ac0a844" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35553 } }
I20260809 16:20:02.612273 30734 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5e5dc0bfb464ace88594c818ac0a844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e5dc0bfb464ace88594c818ac0a844" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35553 } } }
I20260809 16:20:02.612380 30734 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:02.612274 30733 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5e5dc0bfb464ace88594c818ac0a844. Latest consensus state: current_term: 1 leader_uuid: "d5e5dc0bfb464ace88594c818ac0a844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e5dc0bfb464ace88594c818ac0a844" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35553 } } }
I20260809 16:20:02.612644 30733 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:02.612568 30748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:20:02.613150 30748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:20:02.614326 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:02.607753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42635 (local address 127.27.217.62:35553)
0809 16:20:02.607946 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:02.607954 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:02.607979 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:20:02.608810 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:02.608817 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:02.608863 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:02.608993 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:02.609208 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:02.610164 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:02.611267 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:02.611874 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:02.612332 (+ 458us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:02.613634 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:02.613637 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:02.613637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:20:02.613836 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:02.613875 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:20:02.613890 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:02.613975 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:02.614089 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 16:20:02.614117 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260809 16:20:02.615355 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:20:02.616079 30748 catalog_manager.cc:1347] Generated new cluster ID: 3c1b675e25fb48478386a54ef46c9def
I20260809 16:20:02.616137 30748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:20:02.619812 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:02.616871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56109 (local address 127.27.217.62:35553)
0809 16:20:02.616909 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:02.616911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:02.617017 (+ 106us) server_negotiation.cc:407] Connection header received
0809 16:20:02.617069 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:02.617069 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:02.617077 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:02.617116 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:02.617232 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:02.617792 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:02.618734 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:02.618942 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:02.618993 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:02.619577 (+ 584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:02.619579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:02.619579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:20:02.619583 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:02.619597 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:20:02.619601 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:02.619646 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:02.619733 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 16:20:02.619741 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:20:02.629925 30748 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:20:02.630419 30748 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:20:02.635111 30748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5e5dc0bfb464ace88594c818ac0a844: Generated new TSK 0
I20260809 16:20:02.635277 30748 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:20:02.640522 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30625
W20260809 16:20:02.660832 30602 connection.cc:535] client connection to 127.27.217.62:35553 recv error: Network error: failed to read from TLS socket (remote: 127.27.217.62:35553): Connection reset by peer (error 104)
2026-08-09T16:20:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1429 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:20:02 dist-test-slave-nj21 krb5kdc[30773](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:20:02 dist-test-slave-nj21 krb5kdc[30773](info): set up 2 sockets
Aug 09 16:20:02 dist-test-slave-nj21 krb5kdc[30773](info): commencing operation
krb5kdc: starting...
W20260809 16:20:03.794987 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:20:03 dist-test-slave-nj21 krb5kdc[30773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:20:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:20:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:20:03.908588 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:39765
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:39003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:39765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:20:03.986501 30793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:03.986693 30793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:03.986724 30793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:03.987908 30793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:03.987957 30793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:03.987977 30793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:03.987993 30793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:03.988015 30793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:03.989493 30793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:39003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:39765
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:39765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:03.989722 30793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:03.989916 30793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:03.994433 30804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:03.994407 30801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:03.994560 30793 server_base.cc:1034] running on GCE node
W20260809 16:20:03.994408 30808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:03.994922 30793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:03.995189 30793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:03.996326 30793 hybrid_clock.cc:648] HybridClock initialized: now 1786292403996315 us; error 29 us; skew 500 ppm
Aug 09 16:20:03 dist-test-slave-nj21 krb5kdc[30773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292403, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:03.998657 30793 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:20:03.999071 30793 webserver.cc:460] Webserver started at http://127.27.217.62:44517/ using document root <none> and password file <none>
I20260809 16:20:03.999282 30793 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:03.999329 30793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:03.999462 30793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:04.000484 30793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "b18ccad2f5384c049d943f3ad3aae7c3"
format_stamp: "Formatted at 2026-08-09 16:20:03 on dist-test-slave-nj21"
server_key: "f7be69c23349750780513c1ff5334c55"
server_key_iv: "5c08de62d6008487e502013228a27743"
server_key_version: "encryptionkey@0"
I20260809 16:20:04.000818 30793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "b18ccad2f5384c049d943f3ad3aae7c3"
format_stamp: "Formatted at 2026-08-09 16:20:03 on dist-test-slave-nj21"
server_key: "f7be69c23349750780513c1ff5334c55"
server_key_iv: "5c08de62d6008487e502013228a27743"
server_key_version: "encryptionkey@0"
I20260809 16:20:04.002027 30793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:20:04.002672 30816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:04.002815 30793 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:20:04.002899 30793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "b18ccad2f5384c049d943f3ad3aae7c3"
format_stamp: "Formatted at 2026-08-09 16:20:03 on dist-test-slave-nj21"
server_key: "f7be69c23349750780513c1ff5334c55"
server_key_iv: "5c08de62d6008487e502013228a27743"
server_key_version: "encryptionkey@0"
I20260809 16:20:04.002965 30793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:04.006131 30793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:04.008152 30793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:04.008280 30793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:04.012071 30793 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:39765
I20260809 16:20:04.012101 30906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:39765 every 8 connection(s)
I20260809 16:20:04.012396 30793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:20:04.013319 30907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:04.015524 30907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3: Bootstrap starting.
I20260809 16:20:04.016126 30907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:04.016376 30907 log.cc:824] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:04.017004 30907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3: No bootstrap required, opened a new log
I20260809 16:20:04.018520 30907 raft_consensus.cc:348] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18ccad2f5384c049d943f3ad3aae7c3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39765 } }
I20260809 16:20:04.018652 30907 raft_consensus.cc:374] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:20:04.018675 30907 raft_consensus.cc:729] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b18ccad2f5384c049d943f3ad3aae7c3, State: Initialized, Role: FOLLOWER
I20260809 16:20:04.018805 30907 consensus_queue.cc:260] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18ccad2f5384c049d943f3ad3aae7c3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39765 } }
I20260809 16:20:04.018862 30907 raft_consensus.cc:388] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:20:04.018894 30907 raft_consensus.cc:482] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:20:04.018949 30907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:04.019778 30907 raft_consensus.cc:504] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18ccad2f5384c049d943f3ad3aae7c3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39765 } }
I20260809 16:20:04.019868 30907 leader_election.cc:302] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b18ccad2f5384c049d943f3ad3aae7c3; no voters:
I20260809 16:20:04.020028 30907 leader_election.cc:288] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:20:04.020061 30910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:20:04.020197 30910 raft_consensus.cc:686] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [term 1 LEADER]: Becoming Leader. State: Replica: b18ccad2f5384c049d943f3ad3aae7c3, State: Running, Role: LEADER
I20260809 16:20:04.020256 30907 sys_catalog.cc:564] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:04.020288 30910 consensus_queue.cc:237] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18ccad2f5384c049d943f3ad3aae7c3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39765 } }
I20260809 16:20:04.020685 30912 sys_catalog.cc:455] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b18ccad2f5384c049d943f3ad3aae7c3. Latest consensus state: current_term: 1 leader_uuid: "b18ccad2f5384c049d943f3ad3aae7c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18ccad2f5384c049d943f3ad3aae7c3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39765 } } }
I20260809 16:20:04.020779 30912 sys_catalog.cc:458] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:04.020928 30911 sys_catalog.cc:455] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b18ccad2f5384c049d943f3ad3aae7c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18ccad2f5384c049d943f3ad3aae7c3" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 39765 } } }
I20260809 16:20:04.020993 30911 sys_catalog.cc:458] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:04.021248 30921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:20:04.021672 30921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:20:04.022553 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30793
I20260809 16:20:04.022670 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:20:04.022855 28516 external_mini_cluster.cc:1428] Setting key dd9443e819635f2daa7b1635df19667f
I20260809 16:20:04.023451 30921 catalog_manager.cc:1347] Generated new cluster ID: 8cf7be22c4a8470285238f28c57cd7e8
I20260809 16:20:04.023499 30921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:20:04.029389 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:04.023307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44575 (local address 127.27.217.62:39765)
0809 16:20:04.027887 (+ 4580us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:04.027896 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:04.027931 (+ 35us) server_negotiation.cc:407] Connection header received
0809 16:20:04.028053 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:04.028061 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:04.028092 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:04.028249 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:04.028965 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:04.028969 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:04.028969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:20:04.028973 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:04.029019 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:20:04.029033 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:04.029099 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:04.029155 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 16:20:04.029194 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4534,"thread_start_us":71,"threads_started":1}
I20260809 16:20:04.030388 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:20:04.036782 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:04.031848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48477 (local address 127.27.217.62:39765)
0809 16:20:04.031879 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:04.031881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:04.035870 (+ 3989us) server_negotiation.cc:407] Connection header received
0809 16:20:04.035992 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:04.035993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:04.035999 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:04.036055 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:04.036598 (+ 543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:04.036599 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:04.036599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:20:04.036603 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:04.036617 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:20:04.036622 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:04.036670 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:04.036711 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 16:20:04.036722 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:20:04.046298 30921 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:20:04.046451 30921 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:20:04.060285 30921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b18ccad2f5384c049d943f3ad3aae7c3: Generated new TSK 0
I20260809 16:20:04.060475 30921 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:20:04.065393 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30793
2026-08-09T16:20:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:20:04 dist-test-slave-nj21 krb5kdc[30950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:20:04 dist-test-slave-nj21 krb5kdc[30950](info): set up 2 sockets
Aug 09 16:20:04 dist-test-slave-nj21 krb5kdc[30950](info): commencing operation
krb5kdc: starting...
W20260809 16:20:05.211243 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:20:05 dist-test-slave-nj21 krb5kdc[30950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:20:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:20:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:20:05.322016 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:40571
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:46081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:40571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:20:05.400965 30967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:05.401160 30967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:05.401180 30967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:05.402362 30967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:05.402411 30967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:05.402442 30967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:05.402467 30967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:05.402487 30967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:05.403966 30967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:46081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:40571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:40571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:05.404202 30967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:05.404410 30967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:05.409049 30977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:05.409062 30979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:05.409061 30975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:05.409372 30967 server_base.cc:1034] running on GCE node
I20260809 16:20:05.409623 30967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:05.409898 30967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:05.411053 30967 hybrid_clock.cc:648] HybridClock initialized: now 1786292405411032 us; error 30 us; skew 500 ppm
Aug 09 16:20:05 dist-test-slave-nj21 krb5kdc[30950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292405, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:05.413458 30967 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:20:05.413902 30967 webserver.cc:460] Webserver started at http://127.27.217.62:39463/ using document root <none> and password file <none>
I20260809 16:20:05.414119 30967 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:05.414166 30967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:05.414294 30967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:05.415287 30967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "03758a1d44de4c99a6309b5dc079355a"
format_stamp: "Formatted at 2026-08-09 16:20:05 on dist-test-slave-nj21"
server_key: "049c72bc083f811ad410d911e617836c"
server_key_iv: "08edad75026803bbc2cbf80b5daeb602"
server_key_version: "encryptionkey@0"
I20260809 16:20:05.415606 30967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "03758a1d44de4c99a6309b5dc079355a"
format_stamp: "Formatted at 2026-08-09 16:20:05 on dist-test-slave-nj21"
server_key: "049c72bc083f811ad410d911e617836c"
server_key_iv: "08edad75026803bbc2cbf80b5daeb602"
server_key_version: "encryptionkey@0"
I20260809 16:20:05.416882 30967 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:20:05.417528 30992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:05.417685 30967 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:20:05.417779 30967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "03758a1d44de4c99a6309b5dc079355a"
format_stamp: "Formatted at 2026-08-09 16:20:05 on dist-test-slave-nj21"
server_key: "049c72bc083f811ad410d911e617836c"
server_key_iv: "08edad75026803bbc2cbf80b5daeb602"
server_key_version: "encryptionkey@0"
I20260809 16:20:05.417838 30967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:05.425114 30967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:05.427052 30967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:05.427178 30967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:05.430907 30967 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:40571
I20260809 16:20:05.430941 31086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:40571 every 8 connection(s)
I20260809 16:20:05.431236 30967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:20:05.432094 31088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:05.434244 31088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a: Bootstrap starting.
I20260809 16:20:05.434798 31088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:05.435057 31088 log.cc:824] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:05.435752 31088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a: No bootstrap required, opened a new log
I20260809 16:20:05.436115 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 30967
I20260809 16:20:05.436235 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:20:05.436393 28516 external_mini_cluster.cc:1428] Setting key 2eb658962215ab30fe3af33bcc3da946
I20260809 16:20:05.437912 31088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03758a1d44de4c99a6309b5dc079355a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40571 } }
I20260809 16:20:05.438083 31088 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:20:05.438133 31088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03758a1d44de4c99a6309b5dc079355a, State: Initialized, Role: FOLLOWER
I20260809 16:20:05.438259 31088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03758a1d44de4c99a6309b5dc079355a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40571 } }
I20260809 16:20:05.438339 31088 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:20:05.438374 31088 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:20:05.438436 31088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:05.438952 31088 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03758a1d44de4c99a6309b5dc079355a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40571 } }
I20260809 16:20:05.439038 31088 leader_election.cc:302] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03758a1d44de4c99a6309b5dc079355a; no voters:
I20260809 16:20:05.439182 31088 leader_election.cc:288] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:20:05.439218 31094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:20:05.439325 31094 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [term 1 LEADER]: Becoming Leader. State: Replica: 03758a1d44de4c99a6309b5dc079355a, State: Running, Role: LEADER
I20260809 16:20:05.439466 31088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:05.439463 31094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03758a1d44de4c99a6309b5dc079355a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40571 } }
I20260809 16:20:05.440297 31097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03758a1d44de4c99a6309b5dc079355a. Latest consensus state: current_term: 1 leader_uuid: "03758a1d44de4c99a6309b5dc079355a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03758a1d44de4c99a6309b5dc079355a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40571 } } }
I20260809 16:20:05.440371 31097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:05.440768 31095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03758a1d44de4c99a6309b5dc079355a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03758a1d44de4c99a6309b5dc079355a" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 40571 } } }
I20260809 16:20:05.440840 31095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:05.440956 31109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:20:05.441808 31109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 16:20:05 dist-test-slave-nj21 krb5kdc[30950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:20:05.443281 31109 catalog_manager.cc:1347] Generated new cluster ID: fd9ff193941d4d4c8b0d5e8bd83728ee
I20260809 16:20:05.443336 31109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:20:05.446532 31092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:05.436865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58097 (local address 127.27.217.62:40571)
0809 16:20:05.437022 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:05.437030 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:05.437054 (+ 24us) server_negotiation.cc:407] Connection header received
0809 16:20:05.437510 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:05.437516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:05.437560 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:05.437666 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:05.438439 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:05.439843 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:05.440847 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:05.441311 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:05.441423 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:05.443721 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:05.443724 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:05.443724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:05.443734 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:05.445201 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:05.445525 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:05.445528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:05.445528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:05.445607 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:05.445783 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:05.445784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:05.445784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:05.446008 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:05.446163 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:05.446241 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 16:20:05.446369 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260809 16:20:05.447381 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:20:05.451162 31109 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:20:05.451663 31109 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:20:05.455932 31109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03758a1d44de4c99a6309b5dc079355a: Generated new TSK 0
I20260809 16:20:05.456095 31109 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:20:05.458385 31092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:05.448721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38647 (local address 127.27.217.62:40571)
0809 16:20:05.448753 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:05.448754 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:05.451883 (+ 3129us) server_negotiation.cc:407] Connection header received
0809 16:20:05.451928 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:05.451929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:05.451939 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:05.451991 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:05.452568 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:05.453314 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:05.454310 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:05.454639 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:05.454704 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:05.455960 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:05.455962 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:05.455962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:05.455969 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:05.457446 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:05.457736 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:05.457737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:05.457737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:05.457793 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:05.457945 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:05.457946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:05.457946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:05.458067 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:05.458160 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:05.458222 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 16:20:05.458295 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:20:05.460053 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 30967
2026-08-09T16:20:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:20:05 dist-test-slave-nj21 krb5kdc[31134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:20:05 dist-test-slave-nj21 krb5kdc[31134](info): set up 2 sockets
Aug 09 16:20:05 dist-test-slave-nj21 krb5kdc[31134](info): commencing operation
krb5kdc: starting...
W20260809 16:20:06.605075 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:20:06 dist-test-slave-nj21 krb5kdc[31134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:20:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:20:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:20:06.718106 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35147
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:46875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:35147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:20:06.796442 31152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:06.796633 31152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:06.796663 31152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:06.797770 31152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:06.797808 31152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:06.797827 31152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:06.797842 31152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:06.797857 31152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:06.799309 31152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:46875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:35147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:35147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:06.799546 31152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:06.799777 31152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:06.804335 31160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:06.804327 31161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:06.804307 31164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:06.804553 31152 server_base.cc:1034] running on GCE node
I20260809 16:20:06.804759 31152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:06.805007 31152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:06.806154 31152 hybrid_clock.cc:648] HybridClock initialized: now 1786292406806146 us; error 31 us; skew 500 ppm
Aug 09 16:20:06 dist-test-slave-nj21 krb5kdc[31134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292406, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:06.811348 31152 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:20:06.811798 31152 webserver.cc:460] Webserver started at http://127.27.217.62:41597/ using document root <none> and password file <none>
I20260809 16:20:06.812022 31152 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:06.812067 31152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:06.812191 31152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:06.813163 31152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "af1bc35f706246caa840f48266b7d1a6"
format_stamp: "Formatted at 2026-08-09 16:20:06 on dist-test-slave-nj21"
server_key: "976c65ac0bc7c7fa6007ebb55a5f939d"
server_key_iv: "93e16dea0ab537b60504d648f324a91f"
server_key_version: "encryptionkey@0"
I20260809 16:20:06.813494 31152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "af1bc35f706246caa840f48266b7d1a6"
format_stamp: "Formatted at 2026-08-09 16:20:06 on dist-test-slave-nj21"
server_key: "976c65ac0bc7c7fa6007ebb55a5f939d"
server_key_iv: "93e16dea0ab537b60504d648f324a91f"
server_key_version: "encryptionkey@0"
I20260809 16:20:06.814704 31152 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:20:06.815323 31174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:06.815474 31152 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:20:06.815559 31152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "af1bc35f706246caa840f48266b7d1a6"
format_stamp: "Formatted at 2026-08-09 16:20:06 on dist-test-slave-nj21"
server_key: "976c65ac0bc7c7fa6007ebb55a5f939d"
server_key_iv: "93e16dea0ab537b60504d648f324a91f"
server_key_version: "encryptionkey@0"
I20260809 16:20:06.815623 31152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:06.831902 31152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:06.833552 31152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:06.833683 31152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:06.837363 31152 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:35147
I20260809 16:20:06.837409 31260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:35147 every 8 connection(s)
I20260809 16:20:06.837723 31152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:20:06.838538 31263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:06.840730 31263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6: Bootstrap starting.
I20260809 16:20:06.841282 31263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:06.841538 31263 log.cc:824] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:06.842192 31263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6: No bootstrap required, opened a new log
I20260809 16:20:06.842243 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31152
I20260809 16:20:06.842355 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:20:06.842525 28516 external_mini_cluster.cc:1428] Setting key bd464f8621ededd04a2dc19f7075b9b7
I20260809 16:20:06.844467 31263 raft_consensus.cc:348] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1bc35f706246caa840f48266b7d1a6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35147 } }
I20260809 16:20:06.844616 31263 raft_consensus.cc:374] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:20:06.844653 31263 raft_consensus.cc:729] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1bc35f706246caa840f48266b7d1a6, State: Initialized, Role: FOLLOWER
I20260809 16:20:06.844780 31263 consensus_queue.cc:260] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1bc35f706246caa840f48266b7d1a6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35147 } }
I20260809 16:20:06.844859 31263 raft_consensus.cc:388] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:20:06.844883 31263 raft_consensus.cc:482] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:20:06.844938 31263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:06.845441 31263 raft_consensus.cc:504] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1bc35f706246caa840f48266b7d1a6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35147 } }
I20260809 16:20:06.845525 31263 leader_election.cc:302] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af1bc35f706246caa840f48266b7d1a6; no voters:
I20260809 16:20:06.845670 31263 leader_election.cc:288] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:20:06.845716 31272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:20:06.845839 31272 raft_consensus.cc:686] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [term 1 LEADER]: Becoming Leader. State: Replica: af1bc35f706246caa840f48266b7d1a6, State: Running, Role: LEADER
I20260809 16:20:06.845935 31263 sys_catalog.cc:564] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:06.845980 31272 consensus_queue.cc:237] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1bc35f706246caa840f48266b7d1a6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35147 } }
I20260809 16:20:06.846308 31272 sys_catalog.cc:455] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af1bc35f706246caa840f48266b7d1a6. Latest consensus state: current_term: 1 leader_uuid: "af1bc35f706246caa840f48266b7d1a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1bc35f706246caa840f48266b7d1a6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35147 } } }
I20260809 16:20:06.846457 31272 sys_catalog.cc:458] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:06.846701 31287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:20:06.847077 31275 sys_catalog.cc:455] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af1bc35f706246caa840f48266b7d1a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1bc35f706246caa840f48266b7d1a6" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 35147 } } }
I20260809 16:20:06.847205 31275 sys_catalog.cc:458] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:06.847259 31287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:20:06.848932 31271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:06.842986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55541 (local address 127.27.217.62:35147)
0809 16:20:06.843153 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:06.843160 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:06.843185 (+ 25us) server_negotiation.cc:407] Connection header received
0809 16:20:06.844413 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:06.844421 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:06.844469 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:06.844578 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:06.844823 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:06.845842 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:06.846882 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:06.847476 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:06.847580 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:06.848255 (+ 675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:06.848258 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:06.848258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:20:06.848466 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:06.848505 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:20:06.848520 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:06.848577 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:06.848671 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 16:20:06.848734 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
I20260809 16:20:06.849351 31287 catalog_manager.cc:1347] Generated new cluster ID: 37f48bd72593414cbbe9ebdcd9a2cffb
I20260809 16:20:06.849404 31287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:20:06.849777 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:20:06.854442 31271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:06.851197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60495 (local address 127.27.217.62:35147)
0809 16:20:06.851228 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:06.851230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:06.851350 (+ 120us) server_negotiation.cc:407] Connection header received
0809 16:20:06.851416 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:06.851417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:06.851432 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:06.851486 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:06.851633 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:06.852316 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:06.853296 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:06.853562 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:06.853609 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:06.854230 (+ 621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:06.854231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:06.854232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:20:06.854235 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:06.854248 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:20:06.854251 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:06.854290 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:06.854350 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 16:20:06.854368 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 16:20:06.860208 31287 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:20:06.860687 31287 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:20:06.865754 31287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af1bc35f706246caa840f48266b7d1a6: Generated new TSK 0
I20260809 16:20:06.865911 31287 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:20:06.868321 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31152
2026-08-09T16:20:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:20:06 dist-test-slave-nj21 krb5kdc[31312](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:20:06 dist-test-slave-nj21 krb5kdc[31312](info): set up 2 sockets
Aug 09 16:20:06 dist-test-slave-nj21 krb5kdc[31312](info): commencing operation
krb5kdc: starting...
W20260809 16:20:08.037207 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:20:08 dist-test-slave-nj21 krb5kdc[31312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:20:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:20:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:20:08.148595 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41567
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:41499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:20:08.230170 31329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:08.230368 31329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:08.230398 31329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:08.231519 31329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:08.231560 31329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:08.231580 31329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:08.231595 31329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:08.231611 31329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:08.233101 31329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:41499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:08.233337 31329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:08.233541 31329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:08.238135 31336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:08.238173 31338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:08.238165 31340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:08.238313 31329 server_base.cc:1034] running on GCE node
I20260809 16:20:08.238605 31329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:08.238919 31329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:08.240070 31329 hybrid_clock.cc:648] HybridClock initialized: now 1786292408240046 us; error 34 us; skew 500 ppm
Aug 09 16:20:08 dist-test-slave-nj21 krb5kdc[31312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292408, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:08.242558 31329 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:20:08.242970 31329 webserver.cc:460] Webserver started at http://127.27.217.62:45933/ using document root <none> and password file <none>
I20260809 16:20:08.243182 31329 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:08.243232 31329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:08.243368 31329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:08.244397 31329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "d7dc11d8826948fcb0d89a828c9e2744"
format_stamp: "Formatted at 2026-08-09 16:20:08 on dist-test-slave-nj21"
server_key: "0b3a5a40da1c61ab49f6b6dd42e24249"
server_key_iv: "32f07a7aa142a3b12b7250edb76a7087"
server_key_version: "encryptionkey@0"
I20260809 16:20:08.244726 31329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "d7dc11d8826948fcb0d89a828c9e2744"
format_stamp: "Formatted at 2026-08-09 16:20:08 on dist-test-slave-nj21"
server_key: "0b3a5a40da1c61ab49f6b6dd42e24249"
server_key_iv: "32f07a7aa142a3b12b7250edb76a7087"
server_key_version: "encryptionkey@0"
I20260809 16:20:08.245959 31329 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 16:20:08.246680 31349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:08.246874 31329 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:20:08.246958 31329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "d7dc11d8826948fcb0d89a828c9e2744"
format_stamp: "Formatted at 2026-08-09 16:20:08 on dist-test-slave-nj21"
server_key: "0b3a5a40da1c61ab49f6b6dd42e24249"
server_key_iv: "32f07a7aa142a3b12b7250edb76a7087"
server_key_version: "encryptionkey@0"
I20260809 16:20:08.247016 31329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:08.250224 31329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:08.252008 31329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:08.252125 31329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:08.255856 31329 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:41567
I20260809 16:20:08.255885 31427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:41567 every 8 connection(s)
I20260809 16:20:08.256175 31329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:20:08.257081 31428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:08.259188 31428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744: Bootstrap starting.
I20260809 16:20:08.259758 31428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:08.259984 31428 log.cc:824] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:08.260653 31428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744: No bootstrap required, opened a new log
I20260809 16:20:08.262149 31428 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7dc11d8826948fcb0d89a828c9e2744" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41567 } }
I20260809 16:20:08.262276 31428 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 16:20:08.262306 31428 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7dc11d8826948fcb0d89a828c9e2744, State: Initialized, Role: FOLLOWER
I20260809 16:20:08.262437 31428 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7dc11d8826948fcb0d89a828c9e2744" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41567 } }
I20260809 16:20:08.262490 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31329
I20260809 16:20:08.262518 31428 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 16:20:08.262552 31428 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 16:20:08.262576 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:20:08.262599 31428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:08.262748 28516 external_mini_cluster.cc:1428] Setting key 2110706af0364b8163dc9cf768c86863
I20260809 16:20:08.263621 31428 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7dc11d8826948fcb0d89a828c9e2744" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41567 } }
I20260809 16:20:08.263761 31428 leader_election.cc:302] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7dc11d8826948fcb0d89a828c9e2744; no voters:
I20260809 16:20:08.263913 31428 leader_election.cc:288] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 16:20:08.263967 31435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:20:08.264103 31435 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [term 1 LEADER]: Becoming Leader. State: Replica: d7dc11d8826948fcb0d89a828c9e2744, State: Running, Role: LEADER
I20260809 16:20:08.264199 31428 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:08.264230 31435 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7dc11d8826948fcb0d89a828c9e2744" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41567 } }
I20260809 16:20:08.264860 31434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:08.263199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58515 (local address 127.27.217.62:41567)
0809 16:20:08.263384 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:08.263394 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:08.263428 (+ 34us) server_negotiation.cc:407] Connection header received
0809 16:20:08.263537 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:08.263544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:08.263572 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:08.263742 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:08.264357 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:08.264360 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:08.264360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:20:08.264364 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:08.264404 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:20:08.264420 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:08.264479 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:08.264635 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 16:20:08.264679 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260809 16:20:08.265480 31438 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7dc11d8826948fcb0d89a828c9e2744" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7dc11d8826948fcb0d89a828c9e2744" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41567 } } }
I20260809 16:20:08.265493 31436 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7dc11d8826948fcb0d89a828c9e2744. Latest consensus state: current_term: 1 leader_uuid: "d7dc11d8826948fcb0d89a828c9e2744" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7dc11d8826948fcb0d89a828c9e2744" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41567 } } }
I20260809 16:20:08.265736 31438 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:08.265861 31436 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:08.265869 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 16:20:08.266063 31455 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:20:08.266103 31455 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:20:08.266999 31458 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:20:08.267233 31458 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:20:08.268587 31434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:08.267391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49601 (local address 127.27.217.62:41567)
0809 16:20:08.267426 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:08.267428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:08.267647 (+ 219us) server_negotiation.cc:407] Connection header received
0809 16:20:08.267733 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:08.267733 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:08.267749 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:08.267803 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:08.268369 (+ 566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:08.268370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:08.268370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 16:20:08.268374 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:08.268389 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 16:20:08.268393 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:08.268448 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:08.268516 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 16:20:08.268528 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:20:08.268805 31458 catalog_manager.cc:1347] Generated new cluster ID: f8fe70c041f1477d93df6799e0a65c10
I20260809 16:20:08.268857 31458 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:20:08.278378 31458 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:20:08.278514 31458 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:20:08.292320 31458 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7dc11d8826948fcb0d89a828c9e2744: Generated new TSK 0
I20260809 16:20:08.292486 31458 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:20:08.302170 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31329
2026-08-09T16:20:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1422 ms)
[----------] 18 tests from AuthTokenIssuingTest (25532 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:20:08 dist-test-slave-nj21 krb5kdc[31474](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:20:08 dist-test-slave-nj21 krb5kdc[31474](info): set up 2 sockets
Aug 09 16:20:08 dist-test-slave-nj21 krb5kdc[31474](info): commencing operation
krb5kdc: starting...
W20260809 16:20:09.450297 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:20:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:20:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:20:09.566780 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41627
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41627,127.27.217.61:34637,127.27.217.60:34059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:20:09.647085 31495 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 16:20:09.647312 31495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:09.647336 31495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:09.647361 31495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:09.648502 31495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:09.648545 31495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:09.648563 31495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:09.648581 31495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:09.648597 31495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:09.650081 31495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41627,127.27.217.61:34637,127.27.217.60:34059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:41627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:09.650333 31495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:09.650547 31495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:09.655028 31503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:09.655037 31502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:09.655218 31495 server_base.cc:1034] running on GCE node
W20260809 16:20:09.655174 31509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:09.655541 31495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:09.655858 31495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:09.656991 31495 hybrid_clock.cc:648] HybridClock initialized: now 1786292409656982 us; error 27 us; skew 500 ppm
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:09.659525 31495 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:20:09.660036 31495 webserver.cc:460] Webserver started at http://127.27.217.62:39721/ using document root <none> and password file <none>
I20260809 16:20:09.660276 31495 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:09.660341 31495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:09.660476 31495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:09.661713 31495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "2f5646c673b5437ea9acc83ea07fdb4e"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "fae731e3eb2c97c2fedca2927be31749"
server_key_iv: "f86f0687b59613174e04cf0c72d92664"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.662056 31495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "2f5646c673b5437ea9acc83ea07fdb4e"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "fae731e3eb2c97c2fedca2927be31749"
server_key_iv: "f86f0687b59613174e04cf0c72d92664"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.663273 31495 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:20:09.663955 31522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:09.664109 31495 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:20:09.664197 31495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "2f5646c673b5437ea9acc83ea07fdb4e"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "fae731e3eb2c97c2fedca2927be31749"
server_key_iv: "f86f0687b59613174e04cf0c72d92664"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.664256 31495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:09.682334 31495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:09.684654 31495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:09.684795 31495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:09.688766 31495 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:41627
I20260809 16:20:09.688808 31590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:41627 every 8 connection(s)
I20260809 16:20:09.689132 31495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:20:09.690061 31591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:09.691577 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31495
I20260809 16:20:09.691691 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
I20260809 16:20:09.691592 31591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:09.691872 28516 external_mini_cluster.cc:1428] Setting key d0cd1bc9c106bde8d4f688b851c93d63
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.217.61@KRBTEST.COM; defaulting to no policy
I20260809 16:20:09.701967 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.692338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41627 (local address 127.0.0.1:50054)
0809 16:20:09.693623 (+ 1285us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.693660 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:09.694106 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:09.694375 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:09.694377 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:09.694629 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:09.694783 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.694787 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.695893 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.695894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.696573 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.696575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.697052 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.697053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.697115 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.697645 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:09.697652 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:09.699121 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:09.700714 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.700721 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.700723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.700913 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.701111 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.701112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.701112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.701181 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.701466 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:09.701469 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:09.701521 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 16:20:09.701584 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 16:20:09.701781 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1249,"mutex_wait_us":80,"thread_start_us":104,"threads_started":1}
I20260809 16:20:09.701968 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.692350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50054 (local address 127.27.217.62:41627)
0809 16:20:09.692519 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:09.692526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:09.693750 (+ 1224us) server_negotiation.cc:407] Connection header received
0809 16:20:09.694246 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:09.694248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:09.694270 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:09.694388 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:09.694880 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.695731 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.696648 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.696962 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.697058 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.699205 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:09.699213 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:09.699213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:09.699219 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:09.700640 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.700979 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.700981 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.700982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.701061 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.701226 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.701226 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.701226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.701417 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:09.701480 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:09.701620 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 16:20:09.701726 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.61@KRBTEST.COM" created.
I20260809 16:20:09.702692 31591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:09.703044 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.702904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37652)
0809 16:20:09.702971 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.703022 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 16:20:09.703177 31523 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
I20260809 16:20:09.703568 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.703486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37658)
0809 16:20:09.703520 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.703548 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260809 16:20:09.703665 31591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:34637: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab.
Entry for principal kudu/127.27.217.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab.
I20260809 16:20:09.717681 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.61:34637
--webserver_interface=127.27.217.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab
--principal=kudu/127.27.217.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41627,127.27.217.61:34637,127.27.217.60:34059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:20:09.752933 31591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } attempt: 1
I20260809 16:20:09.753580 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.753413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37668)
0809 16:20:09.753483 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.753537 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 16:20:09.753901 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.753812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37678)
0809 16:20:09.753850 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.753878 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:20:09.753998 31591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:34637: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
W20260809 16:20:09.802843 31603 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 16:20:09.803062 31603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:09.803081 31603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:09.803107 31603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:09.804306 31603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:09.804351 31603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:09.804368 31603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:09.804396 31603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:09.804421 31603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:09.805912 31603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41627,127.27.217.61:34637,127.27.217.60:34059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab
--principal=kudu/127.27.217.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.61:34637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.217.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:09.806149 31603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:09.806366 31603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:09.810912 31611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:09.810912 31616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:09.810974 31610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:09.811120 31603 server_base.cc:1034] running on GCE node
I20260809 16:20:09.811334 31603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:09.811568 31603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:09.812701 31603 hybrid_clock.cc:648] HybridClock initialized: now 1786292409812685 us; error 31 us; skew 500 ppm
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:09.815058 31603 init.cc:377] Logged in from keytab as kudu/127.27.217.61@KRBTEST.COM (short username kudu)
I20260809 16:20:09.815465 31603 webserver.cc:460] Webserver started at http://127.27.217.61:41863/ using document root <none> and password file <none>
I20260809 16:20:09.815637 31603 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:09.815716 31603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:09.815819 31603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:09.816807 31603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/data/instance:
uuid: "b4240c9a88f44067927a1b5fde0cafa8"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "a04cb1a42e0326205b353feacd48f7ac"
server_key_iv: "1202bf8e94052649d7b969643f394a67"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.817111 31603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/wal/instance:
uuid: "b4240c9a88f44067927a1b5fde0cafa8"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "a04cb1a42e0326205b353feacd48f7ac"
server_key_iv: "1202bf8e94052649d7b969643f394a67"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.818325 31603 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:20:09.818971 31631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:09.819137 31603 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:20:09.819226 31603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/wal
uuid: "b4240c9a88f44067927a1b5fde0cafa8"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "a04cb1a42e0326205b353feacd48f7ac"
server_key_iv: "1202bf8e94052649d7b969643f394a67"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.819284 31603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:09.822140 31591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } attempt: 2
I20260809 16:20:09.822537 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.822392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37682)
0809 16:20:09.822457 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.822499 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 16:20:09.822845 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.822768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37688)
0809 16:20:09.822805 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.822828 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 16:20:09.822923 31591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:34637: Network error: Client connection negotiation failed: client connection to 127.27.217.61:34637: connect: Connection refused (error 111)
I20260809 16:20:09.833801 31603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:09.835484 31603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:09.835593 31603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:09.839443 31603 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.61:34637
I20260809 16:20:09.839488 31706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.61:34637 every 8 connection(s)
I20260809 16:20:09.839861 31603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
I20260809 16:20:09.840816 31707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:09.842166 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31603
I20260809 16:20:09.842253 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-1/wal/instance
I20260809 16:20:09.842415 28516 external_mini_cluster.cc:1428] Setting key 8a669b8e04290c0a711f15c0e762dd86
I20260809 16:20:09.842401 31707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.217.60@KRBTEST.COM; defaulting to no policy
I20260809 16:20:09.850927 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.843112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50064 (local address 127.27.217.62:41627)
0809 16:20:09.843155 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:09.843157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:09.843360 (+ 203us) server_negotiation.cc:407] Connection header received
0809 16:20:09.843839 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:09.843841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:09.843857 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:09.843925 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:09.844499 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.844981 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.845914 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.846122 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.846178 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.848421 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:09.848422 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:09.848422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:09.848429 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:09.849671 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.850064 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.850065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.850066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.850117 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.850327 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.850328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.850328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.850435 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:09.850491 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:09.850739 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 16:20:09.850822 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:20:09.851131 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.843097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41627 (local address 127.0.0.1:50064)
0809 16:20:09.843253 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.843287 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:09.843751 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:09.843975 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:09.843978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:09.844211 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:09.844398 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.844402 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.845061 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.845062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.845828 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.845830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.846204 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.846205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.846324 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.846780 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:09.846788 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:09.848327 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:09.849745 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.849751 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.849753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.849996 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.850170 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.850171 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.850171 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.850274 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.850489 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:09.850496 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:09.850626 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 16:20:09.850711 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 16:20:09.850919 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260809 16:20:09.851655 31707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.60@KRBTEST.COM" created.
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:20:09.858623 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.851929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37696)
0809 16:20:09.851963 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.851974 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:09.852053 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:09.852263 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:09.852263 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:09.852382 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:09.852477 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.852479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.853308 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.853309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.853794 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.853796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.854383 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.854384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.854450 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.854778 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:09.854783 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:09.856062 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:09.857584 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.857585 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.857586 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.857792 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.857979 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.857979 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.857980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.858043 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.858272 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:09.858273 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:09.858320 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 16:20:09.858392 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 16:20:09.858499 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":2}
I20260809 16:20:09.858636 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.851999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37696 (local address 127.27.217.61:34637)
0809 16:20:09.852146 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:09.852150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:09.852166 (+ 16us) server_negotiation.cc:407] Connection header received
0809 16:20:09.852183 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:09.852185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:09.852195 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:09.852254 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:09.852535 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.853229 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.853861 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.854286 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.854351 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.856153 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:09.856159 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:09.856160 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:09.856165 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:09.857502 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.857876 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.857878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.857879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.857926 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.858099 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.858099 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.858099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.858218 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:09.858272 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:09.858413 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 16:20:09.858542 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
I20260809 16:20:09.859280 31707 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:09.859563 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.859458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60462)
0809 16:20:09.859491 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.859539 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260809 16:20:09.859712 31633 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
I20260809 16:20:09.860088 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.859988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60470)
0809 16:20:09.860035 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.860064 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 16:20:09.860188 31707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:34059: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab.
Entry for principal kudu/127.27.217.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab.
I20260809 16:20:09.867092 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.60:34059
--webserver_interface=127.27.217.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab
--principal=kudu/127.27.217.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:41627,127.27.217.61:34637,127.27.217.60:34059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:20:09.909407 31707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } attempt: 1
I20260809 16:20:09.909976 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.909813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60482)
0809 16:20:09.909902 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.909943 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 16:20:09.910303 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.910230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60496)
0809 16:20:09.910265 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.910287 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 16:20:09.910377 31707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:34059: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
I20260809 16:20:09.914055 31591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } attempt: 3
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:20:09.920775 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.914383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37706 (local address 127.27.217.61:34637)
0809 16:20:09.914426 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:09.914428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:09.914438 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:20:09.914506 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:09.914507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:09.914517 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:09.914553 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:09.914911 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.915390 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.916378 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.916604 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.916652 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.918548 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:09.918549 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:09.918549 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:09.918555 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:09.919805 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.920104 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.920105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.920105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.920155 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.920316 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.920317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.920317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.920423 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:09.920481 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:09.920614 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 16:20:09.920683 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 16:20:09.920779 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.914312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37706)
0809 16:20:09.914368 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.914381 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:09.914438 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:09.914572 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:09.914573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:09.914766 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:09.914848 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.914851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.915453 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.915454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.916309 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.916312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.916662 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.916663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.916737 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.917134 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:09.917139 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:09.918467 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:09.919884 (+ 1417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.919885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.919885 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.920046 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.920208 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.920209 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.920209 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.920267 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.920478 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:09.920479 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:09.920528 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 16:20:09.920587 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 16:20:09.920683 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 16:20:09.921239 31591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:09.921576 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.921492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60500)
0809 16:20:09.921523 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.921549 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260809 16:20:09.921911 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.921840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60514)
0809 16:20:09.921875 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.921896 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260809 16:20:09.921986 31591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:34059: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
W20260809 16:20:09.949976 31717 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 16:20:09.950179 31717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:09.950196 31717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:09.950212 31717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:09.951272 31717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:09.951303 31717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:09.951316 31717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:09.951327 31717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:09.951344 31717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:09.952841 31717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:41627,127.27.217.61:34637,127.27.217.60:34059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab
--principal=kudu/127.27.217.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.60:34059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.217.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:09.953035 31717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:09.953150 31591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } attempt: 1
I20260809 16:20:09.953255 31717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 16:20:09.953580 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.953448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60530)
0809 16:20:09.953505 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.953547 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 16:20:09.953902 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.953831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60532)
0809 16:20:09.953865 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.953887 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260809 16:20:09.953984 31591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:34059: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
W20260809 16:20:09.957871 31727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:09.957968 31717 server_base.cc:1034] running on GCE node
W20260809 16:20:09.957892 31724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:09.957876 31725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:09.958276 31717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:09.958567 31717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:09.959725 31717 hybrid_clock.cc:648] HybridClock initialized: now 1786292409959709 us; error 25 us; skew 500 ppm
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:09.962076 31717 init.cc:377] Logged in from keytab as kudu/127.27.217.60@KRBTEST.COM (short username kudu)
I20260809 16:20:09.962466 31717 webserver.cc:460] Webserver started at http://127.27.217.60:37679/ using document root <none> and password file <none>
I20260809 16:20:09.962646 31717 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:09.962683 31717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:09.962774 31717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:09.963833 31717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/data/instance:
uuid: "6ce54ebe3c3c47548ddc8846eb761164"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "d3b6f9393d8437d8afc8a370b3720771"
server_key_iv: "4cc33b3f661010143628b09519ba97f4"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.964133 31717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/wal/instance:
uuid: "6ce54ebe3c3c47548ddc8846eb761164"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "d3b6f9393d8437d8afc8a370b3720771"
server_key_iv: "4cc33b3f661010143628b09519ba97f4"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.965304 31717 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:20:09.965937 31737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:09.966104 31717 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:20:09.966198 31717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/wal
uuid: "6ce54ebe3c3c47548ddc8846eb761164"
format_stamp: "Formatted at 2026-08-09 16:20:09 on dist-test-slave-nj21"
server_key: "d3b6f9393d8437d8afc8a370b3720771"
server_key_iv: "4cc33b3f661010143628b09519ba97f4"
server_key_version: "encryptionkey@0"
I20260809 16:20:09.966271 31717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:09.976665 31717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:09.978251 31717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:09.978371 31717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:09.978502 31707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } attempt: 2
I20260809 16:20:09.978881 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.978735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60540)
0809 16:20:09.978798 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.978840 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 16:20:09.979215 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.979115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60550)
0809 16:20:09.979161 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.979193 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 16:20:09.979306 31707 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:34059: Network error: Client connection negotiation failed: client connection to 127.27.217.60:34059: connect: Connection refused (error 111)
I20260809 16:20:09.982339 31717 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.60:34059
I20260809 16:20:09.982370 31821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.60:34059 every 8 connection(s)
I20260809 16:20:09.982681 31717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
I20260809 16:20:09.983623 31822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:09.985116 31822 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:20:09.992147 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 31717
I20260809 16:20:09.992247 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786292143139430-28516-0/minicluster-data/master-2/wal/instance
I20260809 16:20:09.992389 28516 external_mini_cluster.cc:1428] Setting key f99cd31317ae1df285e2895a99582d5b
I20260809 16:20:09.993312 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.985737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50074 (local address 127.27.217.62:41627)
0809 16:20:09.985791 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:09.985792 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:09.985972 (+ 180us) server_negotiation.cc:407] Connection header received
0809 16:20:09.986446 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:09.986448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:09.986460 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:09.986513 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:09.987089 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.987546 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.988521 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.988705 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.988761 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.990695 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:09.990696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:09.990696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:09.990703 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:09.991954 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.992330 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.992332 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.992332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.992388 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.992632 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.992633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.992633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.992786 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:09.992856 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:09.993132 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 16:20:09.993221 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:20:09.993445 31825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.985687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:41627 (local address 127.0.0.1:50074)
0809 16:20:09.985862 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.985897 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:09.986343 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:09.986583 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:09.986587 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:09.986821 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:09.987007 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.987010 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.987621 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.987622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.988442 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.988444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.988782 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.988783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.988904 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.989326 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:09.989334 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:09.990612 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:09.992029 (+ 1417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.992036 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.992038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.992272 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.992440 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.992441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.992441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.992561 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.992854 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:09.992859 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:09.992993 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 16:20:09.993100 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 16:20:09.993265 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260809 16:20:09.993942 31822 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
Aug 09 16:20:09 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:20:10.000339 31825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.994147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:34637 (local address 127.0.0.1:37718)
0809 16:20:09.994187 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:09.994198 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:09.994239 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:09.994345 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:09.994346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:09.994485 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:09.994533 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.994534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.995243 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.995244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.995845 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:09.995847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.996183 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.996184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:09.996227 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.996675 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:09.996678 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:09.997937 (+ 1259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:09.999407 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.999408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.999408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.999592 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:09.999785 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:09.999785 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:09.999786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:09.999841 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:10.000052 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:10.000053 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:10.000095 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 16:20:10.000155 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 16:20:10.000245 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 16:20:10.000340 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.994217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37718 (local address 127.27.217.61:34637)
0809 16:20:09.994257 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:09.994259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:09.994268 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:20:09.994292 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:09.994293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:09.994302 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:09.994341 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:09.994598 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.995168 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.995910 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.996115 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.996178 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.998026 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:09.998027 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:09.998028 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:09.998035 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:09.999334 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.999650 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.999651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.999652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:09.999730 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:09.999892 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:09.999892 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:09.999893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.000000 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.000054 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.000184 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.000248 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:20:10.000684 31822 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:10.001354 31830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:09.992753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60562 (local address 127.27.217.60:34059)
0809 16:20:09.992905 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:09.992909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:09.993052 (+ 143us) server_negotiation.cc:407] Connection header received
0809 16:20:09.993074 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:09.993077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:09.993091 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:09.993165 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:09.993844 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.994745 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.995595 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:09.996041 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:09.996089 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:09.998580 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:09.998589 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:09.998590 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:09.998598 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.000145 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.000539 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.000542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.000542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.000601 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.000804 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.000805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.000805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.000981 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.001107 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.001184 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.001259 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":126,"thread_start_us":75,"threads_started":1}
Aug 09 16:20:10 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
Aug 09 16:20:10 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:20:10.007851 31825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.000921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60578)
0809 16:20:10.001098 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:10.001108 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:10.001151 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:10.001291 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:10.001292 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:10.001431 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:10.001464 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:10.001465 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.002247 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.002248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:10.002767 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:10.002769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.003094 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.003095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:10.003144 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.003568 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:10.003572 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:10.004691 (+ 1119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:10.006832 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:10.006833 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:10.006833 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:10.006988 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:10.007187 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:10.007188 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:10.007188 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:10.007230 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:10.007473 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:10.007474 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:10.007521 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 16:20:10.007590 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 16:20:10.007715 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260809 16:20:10.007926 31835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.000975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60578 (local address 127.27.217.60:34059)
0809 16:20:10.001131 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.001133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.001151 (+ 18us) server_negotiation.cc:407] Connection header received
0809 16:20:10.001204 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.001204 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.001213 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.001284 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.001525 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.002177 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.002841 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.003038 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.003083 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.004785 (+ 1702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:10.004787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:10.004788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:10.004793 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.006757 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.007050 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.007050 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.007051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.007131 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.007266 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.007266 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.007267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.007390 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.007454 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.007626 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.007771 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260809 16:20:10.009335 31822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164: Bootstrap starting.
I20260809 16:20:10.009886 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.002125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50080 (local address 127.27.217.62:41627)
0809 16:20:10.002162 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.002163 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.002207 (+ 44us) server_negotiation.cc:407] Connection header received
0809 16:20:10.002270 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.002270 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.002280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.002330 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.002729 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.003280 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.004052 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.004249 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.004303 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.006606 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:10.006607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:10.006608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:10.006615 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.008730 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.009100 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.009100 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.009100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.009143 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.009313 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.009314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.009314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.009420 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.009553 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.009720 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.009790 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 16:20:10.009992 31822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:10.010296 31822 log.cc:824] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:10.011001 31822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164: No bootstrap required, opened a new log
I20260809 16:20:10.012457 31822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } }
I20260809 16:20:10.012579 31822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ce54ebe3c3c47548ddc8846eb761164, State: Initialized, Role: FOLLOWER
I20260809 16:20:10.012656 31822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } }
I20260809 16:20:10.012979 31822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:10.012923 31838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.013043 31838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 16:20:10 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
W20260809 16:20:10.014779 31863 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:20:10.014820 31863 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:20:10.015021 31717 master_runner.cc:186] Error getting master registration for 127.27.217.62:41627: OK, instance_id { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" instance_seqno: 1786292409687619 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 16:20:10.017277 31717 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 16:20:10.018142 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.010570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37734 (local address 127.27.217.61:34637)
0809 16:20:10.010614 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.010615 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.010623 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:20:10.010645 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.010646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.010655 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.010706 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.011138 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.011601 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.012242 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.012455 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.012509 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.014908 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:10.014909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:10.014909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:10.014916 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.016997 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.017395 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.017396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.017396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.017456 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.017643 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.017644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.017644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.017772 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.017930 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.017970 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.018049 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 16:20:10.019515 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:20:10.020537 31555 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2f5646c673b5437ea9acc83ea07fdb4e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50080
I20260809 16:20:10.029136 31591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } attempt: 2
Aug 09 16:20:10 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:20:10.036437 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.029437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60590)
0809 16:20:10.029502 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:10.029513 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:10.029565 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:10.029715 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:10.029715 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:10.029902 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:10.029955 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:10.029957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.030570 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.030571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:10.031381 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:10.031383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.031772 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.031773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:10.031826 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.032288 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:10.032292 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:10.033820 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:10.035449 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:10.035450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:10.035451 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:10.035612 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:10.035811 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:10.035811 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:10.035812 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:10.035869 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:10.036127 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:10.036128 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:10.036176 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 16:20:10.036236 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 16:20:10.036335 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 16:20:10.036446 31835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.029532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60590 (local address 127.27.217.60:34059)
0809 16:20:10.029587 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.029589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.029609 (+ 20us) server_negotiation.cc:407] Connection header received
0809 16:20:10.029631 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.029631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.029660 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.029702 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.030018 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.030496 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.031469 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.031712 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.031771 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.033903 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:10.033904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:10.033905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:10.033912 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.035363 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.035696 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.035697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.035698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.035755 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.035920 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.035921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.035921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.036066 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.036125 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.036277 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.036353 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:20:10.038018 31591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e: Bootstrap starting.
I20260809 16:20:10.038673 31591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:10.038932 31591 log.cc:824] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:10.039633 31591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e: No bootstrap required, opened a new log
I20260809 16:20:10.040653 31591 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } }
I20260809 16:20:10.040766 31591 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f5646c673b5437ea9acc83ea07fdb4e, State: Initialized, Role: FOLLOWER
I20260809 16:20:10.040840 31591 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } }
I20260809 16:20:10.041095 31869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.041154 31591 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:10.041175 31869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:10.041286 31555 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 16:20:10.041379 31555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:10.042165 31555 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } }
W20260809 16:20:10.043102 31883 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:20:10.043193 31883 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:20:10.043706 31786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6ce54ebe3c3c47548ddc8846eb761164"
I20260809 16:20:10.043843 31786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:10.044797 31786 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f5646c673b5437ea9acc83ea07fdb4e in term 1.
I20260809 16:20:10.045262 31524 leader_election.cc:302] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f5646c673b5437ea9acc83ea07fdb4e, 6ce54ebe3c3c47548ddc8846eb761164; no voters:
I20260809 16:20:10.045395 31869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:20:10.045526 31869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [term 1 LEADER]: Becoming Leader. State: Replica: 2f5646c673b5437ea9acc83ea07fdb4e, State: Running, Role: LEADER
I20260809 16:20:10.045603 31869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } }
I20260809 16:20:10.045972 31869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5646c673b5437ea9acc83ea07fdb4e. Latest consensus state: current_term: 1 leader_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.046046 31869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:10.046170 31555 leader_election.cc:288] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [CANDIDATE]: Term 1 election: Requested vote from peers b4240c9a88f44067927a1b5fde0cafa8 (127.27.217.61:34637), 6ce54ebe3c3c47548ddc8846eb761164 (127.27.217.60:34059)
I20260809 16:20:10.045321 31495 master_runner.cc:186] Error getting master registration for 127.27.217.61:34637: OK, instance_id { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" instance_seqno: 1786292409838367 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 16:20:10.047585 31495 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 16:20:10.047567 31889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:20:10.048038 31889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:20:10.049790 31786 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [term 1 FOLLOWER]: Refusing update from remote peer 2f5646c673b5437ea9acc83ea07fdb4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:20:10.050213 31885 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:20:10.052112 31838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5646c673b5437ea9acc83ea07fdb4e. Latest consensus state: current_term: 1 leader_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.052201 31838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:10.056871 31869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.056962 31869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:10.057617 31838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.057705 31838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:10.057928 31898 mvcc.cc:205] Tried to move back new op lower bound from 7316653711561302016 to 7316653711547396096. Current Snapshot: MvccSnapshot[applied={T|T < 7316653711561302016}]
I20260809 16:20:10.058060 31901 mvcc.cc:205] Tried to move back new op lower bound from 7316653711561302016 to 7316653711547396096. Current Snapshot: MvccSnapshot[applied={T|T < 7316653711561302016}]
I20260809 16:20:10.060894 31889 catalog_manager.cc:1347] Generated new cluster ID: b5a777398871469eac0e004b9ee702f6
I20260809 16:20:10.060943 31889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:20:10.062915 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.047283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.27.217.62:41627)
0809 16:20:10.047333 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.047335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.051811 (+ 4476us) server_negotiation.cc:407] Connection header received
0809 16:20:10.052319 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.052320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.052331 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.052400 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.053701 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.054452 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.056165 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.056481 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.056522 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.059331 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:10.059333 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:10.059333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:10.059340 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.060986 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.061694 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.061695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.061696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.061767 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.062141 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.062142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.062142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.062269 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.062353 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.062734 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.062814 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:20:10.066877 31835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.047868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60596 (local address 127.27.217.60:34059)
0809 16:20:10.047909 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.047911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.059806 (+ 11895us) server_negotiation.cc:407] Connection header received
0809 16:20:10.059899 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.059900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.059911 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.059958 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.060856 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.061550 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.062525 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.062821 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.062852 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.064170 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:10.064172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:10.064172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:10.064179 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.065648 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.066036 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.066037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.066038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.066107 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.066331 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.066332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.066332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.066463 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.066588 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.066710 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.066790 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 16:20:10.068298 31889 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:20:10.068998 31889 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:20:10.070448 31707 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } attempt: 3
I20260809 16:20:10.074816 31889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e: Generated new TSK 0
I20260809 16:20:10.074997 31889 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 16:20:10.075541 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.049544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37742 (local address 127.27.217.61:34637)
0809 16:20:10.049587 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.049589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.060798 (+ 11209us) server_negotiation.cc:407] Connection header received
0809 16:20:10.067008 (+ 6210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.067010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.067022 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.067051 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.067707 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.068446 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.069356 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.069715 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.069791 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.071072 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:10.071073 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:10.071074 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:10.071080 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.073829 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.074598 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.074599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.074600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.074659 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.074978 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.074979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.074979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.075104 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.075176 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.075378 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.075451 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 09 16:20:10 dist-test-slave-nj21 krb5kdc[31474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292409, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:20:10.079036 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.070710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:34059 (local address 127.0.0.1:60606)
0809 16:20:10.070764 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:10.070773 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:10.070809 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:10.071015 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:10.071015 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:10.071317 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:10.071358 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:10.071360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.072514 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.072515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:10.073238 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:10.073241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.074305 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.074307 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:10.074360 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.074764 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:10.074769 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:10.076222 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:10.078042 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:10.078043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:10.078044 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:10.078236 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:10.078446 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:10.078447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:10.078447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:10.078502 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:10.078766 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:10.078767 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:10.078807 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 16:20:10.078851 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 16:20:10.078941 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 16:20:10.079466 31835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:10.070751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60606 (local address 127.27.217.60:34059)
0809 16:20:10.070800 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.070802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.070811 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:20:10.070869 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.070870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.070879 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.071211 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.071430 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.072126 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.073933 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:10.074203 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:10.074264 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:10.076329 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:10.076330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:10.076331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:10.076337 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:10.077946 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.078312 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.078313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.078314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.078364 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:10.078578 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:10.078579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:10.078579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:10.078696 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:10.079194 (+ 498us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:10.079233 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 16:20:10.079346 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 16:20:10.081507 31707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8: Bootstrap starting.
I20260809 16:20:10.082245 31707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:10.082540 31707 log.cc:824] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:10.089699 31707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8: No bootstrap required, opened a new log
I20260809 16:20:10.091766 31707 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } }
I20260809 16:20:10.091921 31707 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4240c9a88f44067927a1b5fde0cafa8, State: Initialized, Role: FOLLOWER
I20260809 16:20:10.092000 31707 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } }
I20260809 16:20:10.092334 31707 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:10.093734 31673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b4240c9a88f44067927a1b5fde0cafa8"
I20260809 16:20:10.093848 31673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:10.094753 31673 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f5646c673b5437ea9acc83ea07fdb4e in term 1.
I20260809 16:20:10.095170 31670 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [term 1 FOLLOWER]: Refusing update from remote peer 2f5646c673b5437ea9acc83ea07fdb4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260809 16:20:10.096117 31927 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:20:10.096221 31927 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:20:10.096412 31905 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:20:10.096654 31910 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.097760 31910 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:10.097990 31910 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5646c673b5437ea9acc83ea07fdb4e. Latest consensus state: current_term: 1 leader_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.098114 31910 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:10.098181 31910 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.098269 31910 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:10.100273 31931 mvcc.cc:205] Tried to move back new op lower bound from 7316653711660269568 to 7316653711547396096. Current Snapshot: MvccSnapshot[applied={T|T < 7316653711561302016}]
W20260809 16:20:10.106603 31597 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.105212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50104 (local address 127.27.217.62:41627)
0809 16:20:10.105258 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.105260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.105908 (+ 648us) server_negotiation.cc:407] Connection header received
0809 16:20:10.106009 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.106010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.106022 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.106053 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.106533 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50104: BlockingRecv error: recv got EOF from 127.0.0.1:50104 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260809 16:20:10.107358 31835 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.105618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60610 (local address 127.27.217.60:34059)
0809 16:20:10.105659 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.105661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.106844 (+ 1183us) server_negotiation.cc:407] Connection header received
0809 16:20:10.106954 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.106955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.106966 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.106994 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.107298 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60610: BlockingRecv error: recv got EOF from 127.0.0.1:60610 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 16:20:10.108355 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.107704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37754 (local address 127.27.217.61:34637)
0809 16:20:10.107742 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.107744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.107863 (+ 119us) server_negotiation.cc:407] Connection header received
0809 16:20:10.107955 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.107956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.107966 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.107994 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.108300 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37754: BlockingRecv error: recv got EOF from 127.0.0.1:37754 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 16:20:10.110729 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.109971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37762 (local address 127.27.217.61:34637)
0809 16:20:10.110017 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.110019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.110242 (+ 223us) server_negotiation.cc:407] Connection header received
0809 16:20:10.110342 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.110342 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.110359 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.110386 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.110683 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37762: BlockingRecv error: recv got EOF from 127.0.0.1:37762 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 16:20:10.113698 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.112942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37778 (local address 127.27.217.61:34637)
0809 16:20:10.112990 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.112992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.113236 (+ 244us) server_negotiation.cc:407] Connection header received
0809 16:20:10.113321 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.113322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.113331 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.113356 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.113655 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37778: BlockingRecv error: recv got EOF from 127.0.0.1:37778 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 16:20:10.117457 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.116745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37794 (local address 127.27.217.61:34637)
0809 16:20:10.116778 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.116779 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.116993 (+ 214us) server_negotiation.cc:407] Connection header received
0809 16:20:10.117080 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.117080 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.117090 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.117114 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.117414 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37794: BlockingRecv error: recv got EOF from 127.0.0.1:37794 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 16:20:10.123384 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.122613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37800 (local address 127.27.217.61:34637)
0809 16:20:10.122652 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.122654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.122865 (+ 211us) server_negotiation.cc:407] Connection header received
0809 16:20:10.122971 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.122972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.122982 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.123011 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.123334 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37800: BlockingRecv error: recv got EOF from 127.0.0.1:37800 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260809 16:20:10.133523 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.132656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37804 (local address 127.27.217.61:34637)
0809 16:20:10.132698 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.132700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.132950 (+ 250us) server_negotiation.cc:407] Connection header received
0809 16:20:10.133051 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.133052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.133064 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.133092 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.133454 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37804: BlockingRecv error: recv got EOF from 127.0.0.1:37804 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 16:20:10.151851 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.150917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37808 (local address 127.27.217.61:34637)
0809 16:20:10.150962 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.150964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.151220 (+ 256us) server_negotiation.cc:407] Connection header received
0809 16:20:10.151323 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.151325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.151338 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.151365 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.151788 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37808: BlockingRecv error: recv got EOF from 127.0.0.1:37808 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 16:20:10.186582 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.185313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37818 (local address 127.27.217.61:34637)
0809 16:20:10.185361 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.185363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.185948 (+ 585us) server_negotiation.cc:407] Connection header received
0809 16:20:10.186061 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.186062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.186074 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.186103 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.186519 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37818: BlockingRecv error: recv got EOF from 127.0.0.1:37818 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 16:20:10.252650 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.251957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37832 (local address 127.27.217.61:34637)
0809 16:20:10.252015 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.252017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.252200 (+ 183us) server_negotiation.cc:407] Connection header received
0809 16:20:10.252230 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.252231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.252242 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.252308 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.252599 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37832: BlockingRecv error: recv got EOF from 127.0.0.1:37832 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 16:20:10.382486 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.381784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37846 (local address 127.27.217.61:34637)
0809 16:20:10.381867 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.381869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.381927 (+ 58us) server_negotiation.cc:407] Connection header received
0809 16:20:10.382001 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.382002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.382014 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.382063 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.382421 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37846: BlockingRecv error: recv got EOF from 127.0.0.1:37846 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 16:20:10.510663 31905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f5646c673b5437ea9acc83ea07fdb4e" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 41627 } } peers { permanent_uuid: "b4240c9a88f44067927a1b5fde0cafa8" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 34637 } } peers { permanent_uuid: "6ce54ebe3c3c47548ddc8846eb761164" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 34059 } } }
I20260809 16:20:10.510823 31905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5646c673b5437ea9acc83ea07fdb4e [sys.catalog]: This master's current role is: LEADER
W20260809 16:20:10.640236 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:10.639610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37850 (local address 127.27.217.61:34637)
0809 16:20:10.639705 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:10.639707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:10.639720 (+ 13us) server_negotiation.cc:407] Connection header received
0809 16:20:10.639788 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:10.639789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:10.639800 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:10.639850 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:10.640170 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37850: BlockingRecv error: recv got EOF from 127.0.0.1:37850 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 16:20:11.015233 31863 catalog_manager.cc:1259] Loaded cluster ID: b5a777398871469eac0e004b9ee702f6
I20260809 16:20:11.015311 31863 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164: loading cluster ID for follower catalog manager: success
I20260809 16:20:11.016122 31863 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164: acquiring CA information for follower catalog manager: success
I20260809 16:20:11.016389 31863 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ce54ebe3c3c47548ddc8846eb761164: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 16:20:11.096813 31927 catalog_manager.cc:1259] Loaded cluster ID: b5a777398871469eac0e004b9ee702f6
I20260809 16:20:11.096917 31927 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8: loading cluster ID for follower catalog manager: success
I20260809 16:20:11.097703 31927 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8: acquiring CA information for follower catalog manager: success
I20260809 16:20:11.097958 31927 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b4240c9a88f44067927a1b5fde0cafa8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 16:20:11.155560 32043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:11.153310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37858 (local address 127.27.217.61:34637)
0809 16:20:11.153461 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:11.153463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:11.153474 (+ 11us) server_negotiation.cc:407] Connection header received
0809 16:20:11.153505 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:11.153505 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:11.153566 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:11.153642 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:11.153761 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.154263 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.154959 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.155143 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.155186 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:11.155295 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:11.155403 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:11.155460 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:11.155473 (+ 13us) server_negotiation.cc:299] Negotiation successful
0809 16:20:11.155489 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260809 16:20:11.159276 32050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:11.157305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60624 (local address 127.27.217.60:34059)
0809 16:20:11.157416 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:11.157418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:11.157435 (+ 17us) server_negotiation.cc:407] Connection header received
0809 16:20:11.157470 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:11.157470 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:11.157505 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:11.157571 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:11.157640 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.158113 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.158725 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.158896 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.158939 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:11.159027 (+ 88us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:11.159118 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:11.159164 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:11.159179 (+ 15us) server_negotiation.cc:299] Negotiation successful
0809 16:20:11.159194 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":61,"threads_started":1}
I20260809 16:20:11.163564 32050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:11.160849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60628 (local address 127.27.217.60:34059)
0809 16:20:11.160884 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:11.160885 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:11.160985 (+ 100us) server_negotiation.cc:407] Connection header received
0809 16:20:11.161073 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:11.161073 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:11.161083 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:11.161110 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:11.161285 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.162000 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.162908 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.163170 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.163226 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:11.163361 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:11.163392 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:11.163433 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:11.163483 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 16:20:11.163501 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:20:11.163858 32066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:11.160869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50118 (local address 127.27.217.62:41627)
0809 16:20:11.161004 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:11.161006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:11.161014 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:20:11.161058 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:11.161059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:11.161111 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:11.161181 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:11.161323 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.161811 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.162786 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.163051 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.163111 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:11.163306 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:11.163402 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:11.163450 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:11.163748 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 16:20:11.163776 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260809 16:20:11.164438 32043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:11.160749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37874 (local address 127.27.217.61:34637)
0809 16:20:11.160869 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:11.160872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:11.161044 (+ 172us) server_negotiation.cc:407] Connection header received
0809 16:20:11.161100 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:11.161101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:11.161110 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:11.161150 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:11.161256 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.162001 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.163742 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:11.163988 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:11.164022 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:11.164197 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:11.164231 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:11.164278 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:11.164338 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 16:20:11.164372 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 16:20:11.165405 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31495
I20260809 16:20:11.175559 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31603
I20260809 16:20:11.185040 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 31717
2026-08-09T16:20:11Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2882 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 16:20:11 dist-test-slave-nj21 krb5kdc[32069](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 16:20:11 dist-test-slave-nj21 krb5kdc[32069](info): set up 2 sockets
Aug 09 16:20:11 dist-test-slave-nj21 krb5kdc[32069](info): commencing operation
krb5kdc: starting...
W20260809 16:20:12.332785 28516 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/test-user.keytab.
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T16:20:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T16:20:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.217.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
Entry for principal kudu/127.27.217.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab.
I20260809 16:20:12.444344 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:33515
--webserver_interface=127.27.217.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:37503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:33515,127.27.217.61:41289,127.27.217.60:37033
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 16:20:12.522786 32091 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 16:20:12.522985 32091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:12.523001 32091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:12.523020 32091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:12.524103 32091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:12.524137 32091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:12.524149 32091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:12.524160 32091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:12.524178 32091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:12.525586 32091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:37503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:33515,127.27.217.61:41289,127.27.217.60:37033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.62.keytab
--principal=kudu/127.27.217.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.62:33515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.217.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:12.525765 32091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:12.525938 32091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:12.530467 32100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:12.530627 32091 server_base.cc:1034] running on GCE node
W20260809 16:20:12.530478 32104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:12.530485 32101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:12.530907 32091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:12.531199 32091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:12.532328 32091 hybrid_clock.cc:648] HybridClock initialized: now 1786292412532310 us; error 34 us; skew 500 ppm
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:12.538996 32091 init.cc:377] Logged in from keytab as kudu/127.27.217.62@KRBTEST.COM (short username kudu)
I20260809 16:20:12.539419 32091 webserver.cc:460] Webserver started at http://127.27.217.62:34271/ using document root <none> and password file <none>
I20260809 16:20:12.539631 32091 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:12.539714 32091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:12.539840 32091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:12.540868 32091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/data/instance:
uuid: "71036d0992ac4c8390eea204f10a59d0"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "67fae59c7bdb00529dd69c2510dd201b"
server_key_iv: "f3888bea07f0d8e727b5aa851f871f64"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.541206 32091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/wal/instance:
uuid: "71036d0992ac4c8390eea204f10a59d0"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "67fae59c7bdb00529dd69c2510dd201b"
server_key_iv: "f3888bea07f0d8e727b5aa851f871f64"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.542510 32091 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 16:20:12.543179 32116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:12.543327 32091 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:20:12.543414 32091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/wal
uuid: "71036d0992ac4c8390eea204f10a59d0"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "67fae59c7bdb00529dd69c2510dd201b"
server_key_iv: "f3888bea07f0d8e727b5aa851f871f64"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.543474 32091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:12.554495 32091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:12.556492 32091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:12.556625 32091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:12.560515 32091 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.62:33515
I20260809 16:20:12.560555 32198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.62:33515 every 8 connection(s)
I20260809 16:20:12.560865 32091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/data/info.pb
I20260809 16:20:12.561748 32199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:12.563200 32199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:12.568565 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 32091
I20260809 16:20:12.568660 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-0/wal/instance
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:20:12.568866 28516 external_mini_cluster.cc:1428] Setting key 4dd0cfb651f12a78b7fcb60f3af70a31
I20260809 16:20:12.572059 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.563866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41692 (local address 127.27.217.62:33515)
0809 16:20:12.564583 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.564586 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.564596 (+ 10us) server_negotiation.cc:407] Connection header received
0809 16:20:12.564649 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.564650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.564663 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.564723 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.565273 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.566067 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.566831 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.567124 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.567193 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.569271 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.569277 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.569278 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.569284 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.570625 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.570955 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.570958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.570958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.571030 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.571221 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.571222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.571222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.571414 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.571485 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.571713 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.571889 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":697,"thread_start_us":68,"threads_started":1}
I20260809 16:20:12.572068 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.563821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33515 (local address 127.0.0.1:41692)
0809 16:20:12.563994 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.564027 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.564463 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.564792 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.564794 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.565037 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.565197 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.565201 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.566136 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.566136 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.566769 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.566771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.567195 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.567195 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.567246 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.567734 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.567742 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.569193 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.570700 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.570706 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.570708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.570884 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.571087 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.571088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.571088 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.571168 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.571475 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.571480 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.571543 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.571631 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.571811 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
I20260809 16:20:12.572791 32199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:12.573132 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.573005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34294)
0809 16:20:12.573052 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.573107 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 16:20:12.573268 32120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
I20260809 16:20:12.573652 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.573560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34308)
0809 16:20:12.573601 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.573629 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260809 16:20:12.573755 32199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:41289: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.27.217.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab.
Entry for principal kudu/127.27.217.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab.
I20260809 16:20:12.592779 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.61:41289
--webserver_interface=127.27.217.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab
--principal=kudu/127.27.217.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:37503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:33515,127.27.217.61:41289,127.27.217.60:37033
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:20:12.622985 32199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } attempt: 1
I20260809 16:20:12.623570 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.623397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34322)
0809 16:20:12.623490 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.623534 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 16:20:12.623992 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.623903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34334)
0809 16:20:12.623945 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.623973 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 16:20:12.624091 32199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:41289: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
W20260809 16:20:12.673928 32210 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 16:20:12.674124 32210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:12.674140 32210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:12.674157 32210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:12.675272 32210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:12.675313 32210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:12.675326 32210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:12.675338 32210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:12.675354 32210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:12.676826 32210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:37503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:33515,127.27.217.61:41289,127.27.217.60:37033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.61.keytab
--principal=kudu/127.27.217.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.61:41289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.217.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:12.677021 32210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:12.677186 32210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:12.681556 32218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:12.681599 32223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:12.681561 32217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:12.681780 32210 server_base.cc:1034] running on GCE node
I20260809 16:20:12.682000 32210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:12.682255 32210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:12.683399 32210 hybrid_clock.cc:648] HybridClock initialized: now 1786292412683376 us; error 37 us; skew 500 ppm
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:12.685746 32210 init.cc:377] Logged in from keytab as kudu/127.27.217.61@KRBTEST.COM (short username kudu)
I20260809 16:20:12.686177 32210 webserver.cc:460] Webserver started at http://127.27.217.61:38909/ using document root <none> and password file <none>
I20260809 16:20:12.686362 32210 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:12.686403 32210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:12.686520 32210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:12.687486 32210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/data/instance:
uuid: "c993026f6f76492e8bfb9775fd62cb47"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "2f5836eb5dc0545cc298e09c5e3efe23"
server_key_iv: "c961d3b66c36bc7c56e3be6510acbfe8"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.687819 32210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/wal/instance:
uuid: "c993026f6f76492e8bfb9775fd62cb47"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "2f5836eb5dc0545cc298e09c5e3efe23"
server_key_iv: "c961d3b66c36bc7c56e3be6510acbfe8"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.689016 32210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 16:20:12.689654 32233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:12.689795 32210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 16:20:12.689874 32210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/wal
uuid: "c993026f6f76492e8bfb9775fd62cb47"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "2f5836eb5dc0545cc298e09c5e3efe23"
server_key_iv: "c961d3b66c36bc7c56e3be6510acbfe8"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.689944 32210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:12.692258 32199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } attempt: 2
I20260809 16:20:12.692615 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.692504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34346)
0809 16:20:12.692554 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.692584 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 16:20:12.692952 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.692882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34354)
0809 16:20:12.692914 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.692936 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260809 16:20:12.693037 32199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.61:41289: Network error: Client connection negotiation failed: client connection to 127.27.217.61:41289: connect: Connection refused (error 111)
I20260809 16:20:12.699285 32210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:12.701248 32210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:12.701354 32210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:12.705267 32210 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.61:41289
I20260809 16:20:12.705310 32317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.61:41289 every 8 connection(s)
I20260809 16:20:12.705611 32210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/data/info.pb
I20260809 16:20:12.706523 32318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:12.707096 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 32210
I20260809 16:20:12.707190 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-1/wal/instance
I20260809 16:20:12.707413 28516 external_mini_cluster.cc:1428] Setting key 05721cc177ea7e76e8b2cab67414d409
I20260809 16:20:12.708556 32318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.217.60@KRBTEST.COM; defaulting to no policy
I20260809 16:20:12.717409 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.709524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41704 (local address 127.27.217.62:33515)
0809 16:20:12.709580 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.709582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.709631 (+ 49us) server_negotiation.cc:407] Connection header received
0809 16:20:12.710145 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.710146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.710166 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.710225 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.710852 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.711334 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.712357 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.712575 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.712650 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.715022 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.715023 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.715023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.715029 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.716340 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.716682 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.716683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.716683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.716730 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.716906 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.716907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.716907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.717010 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.717055 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.717275 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.717345 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 16:20:12.717571 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.709319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33515 (local address 127.0.0.1:41704)
0809 16:20:12.709511 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.709555 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.710046 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.710300 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.710304 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.710554 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.710756 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.710760 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.711424 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.711426 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.712269 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.712271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.712670 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.712672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.712806 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.713271 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.713279 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.714913 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.716421 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.716428 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.716429 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.716628 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.716771 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.716772 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.716772 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.716865 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.717052 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.717055 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.717158 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.717253 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.717386 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.217.60@KRBTEST.COM" created.
I20260809 16:20:12.718093 32318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:20:12.725344 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.718315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34360)
0809 16:20:12.718354 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.718364 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.718402 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.718643 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.718644 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.718772 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.718826 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.718827 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.719932 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.719933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.720418 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.720419 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.720884 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.720885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.720943 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.721328 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.721333 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.722501 (+ 1168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.724403 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.724403 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.724404 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.724557 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.724768 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.724769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.724769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.724819 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.725121 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.725121 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.725152 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.725192 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.725278 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 16:20:12.725462 32324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.718384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34360 (local address 127.27.217.61:41289)
0809 16:20:12.718515 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.718519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.718535 (+ 16us) server_negotiation.cc:407] Connection header received
0809 16:20:12.718552 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.718554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.718566 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.718617 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.718902 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.719827 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.720509 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.720816 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.720878 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.722582 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.722591 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.722591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.722599 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.724309 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.724634 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.724637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.724638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.724699 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.724875 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.724875 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.724876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.725059 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.725148 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.725243 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.725356 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":107,"thread_start_us":83,"threads_started":1}
I20260809 16:20:12.726003 32318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:12.726337 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.726197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47796)
0809 16:20:12.726248 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.726314 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 16:20:12.726451 32238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
I20260809 16:20:12.726854 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.726738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47804)
0809 16:20:12.726782 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.726827 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 16:20:12.726984 32318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:37033: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.217.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab.
Entry for principal kudu/127.27.217.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab.
I20260809 16:20:12.733937 28516 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXqQsw3/build/release/bin/kudu
/tmp/dist-test-taskXqQsw3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.60:37033
--webserver_interface=127.27.217.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab
--principal=kudu/127.27.217.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.217.20:37503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.217.62:33515,127.27.217.61:41289,127.27.217.60:37033
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 16:20:12.776206 32318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } attempt: 1
I20260809 16:20:12.776757 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.776590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47818)
0809 16:20:12.776649 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.776689 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 16:20:12.777161 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.777054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47824)
0809 16:20:12.777108 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.777134 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 16:20:12.777275 32318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:37033: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
I20260809 16:20:12.784190 32199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } attempt: 3
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:20:12.790697 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.784519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34366)
0809 16:20:12.784576 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.784587 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.784634 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.784751 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.784751 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.784913 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.784982 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.784985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.785608 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.785609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.786133 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.786135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.786495 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.786496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.786570 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.786975 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.786979 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.788233 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.789874 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.789875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.789875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.790034 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.790202 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.790203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.790203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.790246 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.790479 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.790479 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.790517 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.790560 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.790630 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 16:20:12.790755 32324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.784587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34366 (local address 127.27.217.61:41289)
0809 16:20:12.784648 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.784650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.784659 (+ 9us) server_negotiation.cc:407] Connection header received
0809 16:20:12.784685 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.784686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.784695 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.784740 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.785056 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.785536 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.786206 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.786432 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.786488 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.788318 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.788320 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.788320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.788328 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.789778 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.790090 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.790091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.790091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.790148 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.790291 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.790291 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.790292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.790423 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.790493 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.790586 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.790663 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 16:20:12.791069 32199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:12.791376 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.791287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47834)
0809 16:20:12.791327 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.791353 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 16:20:12.791716 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.791632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47848)
0809 16:20:12.791655 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.791698 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260809 16:20:12.791795 32199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:37033: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
W20260809 16:20:12.814952 32327 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 16:20:12.815151 32327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 16:20:12.815166 32327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 16:20:12.815184 32327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 16:20:12.816303 32327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 16:20:12.816344 32327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 16:20:12.816356 32327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 16:20:12.816367 32327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 16:20:12.816385 32327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 16:20:12.817816 32327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.217.20:37503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.217.62:33515,127.27.217.61:41289,127.27.217.60:37033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/krb5kdc/kudu_127.27.217.60.keytab
--principal=kudu/127.27.217.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.217.60:37033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.217.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 14:59:38 UTC on ccycloud.quasar-muncrq.root.comops.site
build id 4576545
I20260809 16:20:12.818008 32327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 16:20:12.818179 32327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 16:20:12.822624 32335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:12.822606 32337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 16:20:12.822606 32339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 16:20:12.822863 32327 server_base.cc:1034] running on GCE node
I20260809 16:20:12.822912 32199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } attempt: 1
I20260809 16:20:12.823105 32327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 16:20:12.823271 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.823162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47852)
0809 16:20:12.823213 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.823241 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 16:20:12.823434 32327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 16:20:12.823571 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.823481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47868)
0809 16:20:12.823519 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.823542 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 16:20:12.823690 32199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:37033: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
I20260809 16:20:12.824573 32327 hybrid_clock.cc:648] HybridClock initialized: now 1786292412824550 us; error 33 us; skew 500 ppm
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 16:20:12.826911 32327 init.cc:377] Logged in from keytab as kudu/127.27.217.60@KRBTEST.COM (short username kudu)
I20260809 16:20:12.827301 32327 webserver.cc:460] Webserver started at http://127.27.217.60:45687/ using document root <none> and password file <none>
I20260809 16:20:12.827509 32327 fs_manager.cc:359] Metadata directory not provided
I20260809 16:20:12.827551 32327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 16:20:12.827699 32327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 16:20:12.828773 32327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/data/instance:
uuid: "129be16eda02431aae5f79e5aeadae8f"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "2afa1737cddc8401e01bb98056f9b48b"
server_key_iv: "2a06b3584e0378872d4b4552035e018b"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.829093 32327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/wal/instance:
uuid: "129be16eda02431aae5f79e5aeadae8f"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "2afa1737cddc8401e01bb98056f9b48b"
server_key_iv: "2a06b3584e0378872d4b4552035e018b"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.830292 32327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 16:20:12.830919 32347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 16:20:12.831067 32327 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 16:20:12.831151 32327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/data,/tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/wal
uuid: "129be16eda02431aae5f79e5aeadae8f"
format_stamp: "Formatted at 2026-08-09 16:20:12 on dist-test-slave-nj21"
server_key: "2afa1737cddc8401e01bb98056f9b48b"
server_key_iv: "2a06b3584e0378872d4b4552035e018b"
server_key_version: "encryptionkey@0"
I20260809 16:20:12.831202 32327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 16:20:12.845443 32318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } attempt: 2
I20260809 16:20:12.845851 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.845718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47880)
0809 16:20:12.845778 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.845821 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 16:20:12.846185 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.846086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47886)
0809 16:20:12.846138 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.846165 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 16:20:12.846299 32318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.217.60:37033: Network error: Client connection negotiation failed: client connection to 127.27.217.60:37033: connect: Connection refused (error 111)
I20260809 16:20:12.847537 32327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 16:20:12.849231 32327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 16:20:12.849359 32327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 16:20:12.853156 32327 rpc_server.cc:307] RPC server started. Bound to: 127.27.217.60:37033
I20260809 16:20:12.853195 32433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.217.60:37033 every 8 connection(s)
I20260809 16:20:12.853500 32327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/data/info.pb
I20260809 16:20:12.854403 32434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 16:20:12.855942 32434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:12.858768 28516 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXqQsw3/build/release/bin/kudu as pid 32327
I20260809 16:20:12.858866 28516 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXqQsw3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786292143139430-28516-0/minicluster-data/master-2/wal/instance
I20260809 16:20:12.859057 28516 external_mini_cluster.cc:1428] Setting key 00d03d1de7f6ae2bca3193aa7cd39ea1
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:20:12.864712 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.856583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41710 (local address 127.27.217.62:33515)
0809 16:20:12.856637 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.856639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.856823 (+ 184us) server_negotiation.cc:407] Connection header received
0809 16:20:12.857280 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.857281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.857293 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.857344 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.857915 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.858385 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.859510 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.859743 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.859809 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.862090 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.862092 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.862092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.862099 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.863424 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.863858 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.863859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.863860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.863921 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.864127 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.864128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.864128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.864257 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.864330 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.864561 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.864635 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 16:20:12.864861 32436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.856555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.62:33515 (local address 127.0.0.1:41710)
0809 16:20:12.856713 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.856746 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.857188 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.857406 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.857409 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.857652 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.857833 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.857837 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.858467 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.858468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.859303 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.859306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.859833 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.859834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.859972 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.860467 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.860476 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.862010 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.863502 (+ 1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.863508 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.863511 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.863791 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.863988 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.863988 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.863988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.864078 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.864319 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.864324 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.864439 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.864519 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.864637 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260809 16:20:12.865355 32434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } has no permanent_uuid. Determining permanent_uuid...
I20260809 16:20:12.867268 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.859405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47898 (local address 127.27.217.60:37033)
0809 16:20:12.859547 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.859556 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.859598 (+ 42us) server_negotiation.cc:407] Connection header received
0809 16:20:12.859651 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.859653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.859695 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.859757 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.860352 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.861301 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.862147 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.862446 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.862503 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.864628 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.864634 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.864634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.864641 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.866211 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.866553 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.866555 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.866555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.866601 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.866764 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.866764 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.866765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.866935 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.867057 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.867097 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.867168 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:20:12.871613 32436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.865606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.61:41289 (local address 127.0.0.1:34378)
0809 16:20:12.865647 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.865656 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.865688 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.865792 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.865792 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.865917 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.865966 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.865968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.866667 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.866668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.867343 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.867345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.867821 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.867822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.867894 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.868208 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.868212 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.869376 (+ 1164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.870756 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.870757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.870758 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.870957 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.871134 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.871134 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.871134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.871179 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.871418 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.871419 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.871450 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.871493 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.871555 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 16:20:12.871695 32324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.865661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34378 (local address 127.27.217.61:41289)
0809 16:20:12.865701 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.865703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.865711 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:20:12.865733 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.865734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.865743 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.865786 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.866027 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.866604 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.867431 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.867761 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.867825 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.869464 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.869466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.869466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.869473 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.870687 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.871020 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.871021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.871022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.871076 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.871225 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.871226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.871227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.871357 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.871432 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.871519 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.871587 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 16:20:12.872120 32434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.62@KRBTEST.COM
I20260809 16:20:12.875135 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.868233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41726 (local address 127.27.217.62:33515)
0809 16:20:12.868286 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.868288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.868295 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:20:12.868313 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.868313 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.868322 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.868377 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.868818 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.869289 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.870235 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.870415 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.870471 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.872721 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.872722 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.872723 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.872728 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.874145 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.874447 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.874447 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.874448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.874511 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.874693 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.874694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.874694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.874824 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.874969 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.875022 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.875078 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.60@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:20:12.878446 32436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.872331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47904)
0809 16:20:12.872413 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.872421 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.872465 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.872570 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.872570 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.872696 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.872728 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.872729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.873473 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.873474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.874106 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.874108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.874486 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.874487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.874525 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.874838 (+ 313us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.874842 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.876104 (+ 1262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.877544 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.877544 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.877545 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.877694 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.877875 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.877876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.877876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.877939 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.878138 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.878139 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.878179 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.878258 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.878352 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 16:20:12.878705 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.872364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47904 (local address 127.27.217.60:37033)
0809 16:20:12.872395 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.872396 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.872453 (+ 57us) server_negotiation.cc:407] Connection header received
0809 16:20:12.872515 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.872516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.872523 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.872564 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.872787 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.873375 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.874182 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.874417 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.874477 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.876178 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.876179 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.876179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.876186 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.877469 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.877746 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.877747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.877748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.877801 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.877994 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.877995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.877995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.878088 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.878132 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.878280 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.878623 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":255,"server-negotiator.queue_time_us":15}
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.217.61@KRBTEST.COM
I20260809 16:20:12.880236 32434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f: Bootstrap starting.
I20260809 16:20:12.881083 32434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:12.881337 32434 log.cc:824] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:12.882081 32434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f: No bootstrap required, opened a new log
I20260809 16:20:12.882649 32324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.875818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.27.217.61:41289)
0809 16:20:12.875863 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.875865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.875909 (+ 44us) server_negotiation.cc:407] Connection header received
0809 16:20:12.875966 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.875967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.875976 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.876034 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.876527 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.877092 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.877876 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.878128 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.878186 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.880443 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.880444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.880444 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.880451 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.881679 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.881976 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.881977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.881978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.882035 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.882211 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.882212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.882212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.882312 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.882460 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.882496 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.882564 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 16:20:12.884004 28516 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 16:20:12.883967 32434 raft_consensus.cc:348] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } }
I20260809 16:20:12.884119 32434 raft_consensus.cc:729] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129be16eda02431aae5f79e5aeadae8f, State: Initialized, Role: FOLLOWER
I20260809 16:20:12.884203 32434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } }
I20260809 16:20:12.884461 32447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.884522 32434 sys_catalog.cc:564] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:12.884572 32447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:12.885048 32157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "71036d0992ac4c8390eea204f10a59d0"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41726
W20260809 16:20:12.886137 32466 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:20:12.886189 32466 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:20:12.886448 32327 master_runner.cc:186] Error getting master registration for 127.27.217.62:33515: OK, instance_id { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" instance_seqno: 1786292412559362 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 16:20:12.889312 32327 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 16:20:12.898788 32199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } attempt: 2
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.62@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:20:12.906288 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.899133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47906 (local address 127.27.217.60:37033)
0809 16:20:12.899175 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.899177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.899216 (+ 39us) server_negotiation.cc:407] Connection header received
0809 16:20:12.899238 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.899238 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.899248 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.899302 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.899620 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.900397 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.901372 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.901678 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.901745 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.903837 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.903838 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.903839 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.903846 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.905104 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.905460 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.905461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.905461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.905517 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.905688 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.905689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.905689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.905855 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.905917 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.906120 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.906195 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:20:12.906302 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.899071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47906)
0809 16:20:12.899119 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.899130 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.899172 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.899314 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.899315 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.899498 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.899551 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.899553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.900469 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.900470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.901293 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.901294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.901742 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.901743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.901795 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.902316 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.902321 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.903753 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.905173 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.905174 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.905175 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.905392 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.905573 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.905574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.905574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.905635 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.905946 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.905948 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.906004 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.906086 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.906188 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260809 16:20:12.907856 32199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0: Bootstrap starting.
I20260809 16:20:12.908599 32199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:12.908890 32199 log.cc:824] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:12.909758 32199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0: No bootstrap required, opened a new log
I20260809 16:20:12.911072 32199 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } }
I20260809 16:20:12.911209 32199 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71036d0992ac4c8390eea204f10a59d0, State: Initialized, Role: FOLLOWER
I20260809 16:20:12.911294 32199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } }
I20260809 16:20:12.911558 32470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.911623 32199 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:12.911638 32470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:12.911767 32157 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 16:20:12.911875 32157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:12.912708 32157 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } }
W20260809 16:20:12.913450 32485 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:20:12.913501 32485 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:20:12.913687 32394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "71036d0992ac4c8390eea204f10a59d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "129be16eda02431aae5f79e5aeadae8f"
I20260809 16:20:12.913811 32394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:12.914664 32394 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71036d0992ac4c8390eea204f10a59d0 in term 1.
I20260809 16:20:12.914889 32118 leader_election.cc:302] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129be16eda02431aae5f79e5aeadae8f, 71036d0992ac4c8390eea204f10a59d0; no voters:
I20260809 16:20:12.915014 32470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 16:20:12.915153 32157 leader_election.cc:288] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [CANDIDATE]: Term 1 election: Requested vote from peers c993026f6f76492e8bfb9775fd62cb47 (127.27.217.61:41289), 129be16eda02431aae5f79e5aeadae8f (127.27.217.60:37033)
I20260809 16:20:12.915164 32470 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [term 1 LEADER]: Becoming Leader. State: Replica: 71036d0992ac4c8390eea204f10a59d0, State: Running, Role: LEADER
I20260809 16:20:12.915319 32470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } }
I20260809 16:20:12.915750 32470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71036d0992ac4c8390eea204f10a59d0. Latest consensus state: current_term: 1 leader_uuid: "71036d0992ac4c8390eea204f10a59d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.915843 32470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:12.914302 32091 master_runner.cc:186] Error getting master registration for 127.27.217.61:41289: OK, instance_id { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" instance_seqno: 1786292412704176 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 16:20:12.916584 32091 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 16:20:12.923451 32490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 16:20:12.923955 32490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 16:20:12.925726 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.917697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41742 (local address 127.27.217.62:33515)
0809 16:20:12.917732 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.917734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.918246 (+ 512us) server_negotiation.cc:407] Connection header received
0809 16:20:12.918336 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.918337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.918346 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.918374 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.919063 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.919796 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.920838 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.921130 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.921170 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.922908 (+ 1738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.922909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.922909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.922916 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.924487 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.924919 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.924920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.924920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.924977 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.925163 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.925164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.925164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.925299 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.925368 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.925564 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.925639 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:20:12.927526 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.917624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47922 (local address 127.27.217.60:37033)
0809 16:20:12.917663 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.917665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.917962 (+ 297us) server_negotiation.cc:407] Connection header received
0809 16:20:12.918102 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.918103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.918126 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.918154 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.919338 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.920092 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.921600 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.921872 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.921935 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.923844 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.923860 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.923860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.923868 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.925362 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.925996 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.925997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.925998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.926070 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.926790 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.926791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.926791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.926946 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.927033 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.927347 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.927436 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:20:12.934366 32324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.917983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34400 (local address 127.27.217.61:41289)
0809 16:20:12.918022 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.918024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.926329 (+ 8305us) server_negotiation.cc:407] Connection header received
0809 16:20:12.926423 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.926424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.926435 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.926464 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.927053 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.927812 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.929019 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.929942 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.930016 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.931384 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.931385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.931385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.931392 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.933104 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.933557 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.933558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.933559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.933630 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.933829 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.933830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.933830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.933965 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.934054 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.934170 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.934259 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 16:20:12.937214 32394 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [term 1 FOLLOWER]: Refusing update from remote peer 71036d0992ac4c8390eea204f10a59d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:20:12.937410 32318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } attempt: 3
I20260809 16:20:12.938303 32487 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:20:12.939764 32447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71036d0992ac4c8390eea204f10a59d0. Latest consensus state: current_term: 1 leader_uuid: "71036d0992ac4c8390eea204f10a59d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.939857 32447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 16:20:12 dist-test-slave-nj21 krb5kdc[32069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786292412, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.217.61@KRBTEST.COM for kudu/127.27.217.60@KRBTEST.COM
I20260809 16:20:12.943207 32470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "71036d0992ac4c8390eea204f10a59d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.943300 32470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:12.943394 32447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "71036d0992ac4c8390eea204f10a59d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.943472 32447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:12.943521 32501 mvcc.cc:205] Tried to move back new op lower bound from 7316653723386388480 to 7316653723301826560. Current Snapshot: MvccSnapshot[applied={T|T < 7316653723386388480}]
I20260809 16:20:12.944422 32490 catalog_manager.cc:1347] Generated new cluster ID: 05f75b5779e54251bc43bd43e31829fd
I20260809 16:20:12.944473 32490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 16:20:12.946543 32502 mvcc.cc:205] Tried to move back new op lower bound from 7316653723386388480 to 7316653723301826560. Current Snapshot: MvccSnapshot[applied={T|T < 7316653723386388480 or (T in {7316653723386388480})}]
I20260809 16:20:12.949198 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.937657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.217.60:37033 (local address 127.0.0.1:47938)
0809 16:20:12.937704 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 16:20:12.937715 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 16:20:12.937749 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 16:20:12.937985 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 16:20:12.937986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 16:20:12.938143 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0809 16:20:12.938188 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.938189 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.939442 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.939443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.940314 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 16:20:12.940317 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.941215 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.941216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 16:20:12.941291 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.941721 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 16:20:12.941725 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 16:20:12.943285 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 16:20:12.947819 (+ 4534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.947820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.947821 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.948039 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.948367 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 16:20:12.948368 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 16:20:12.948368 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 16:20:12.948456 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 16:20:12.948890 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 16:20:12.948891 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 16:20:12.948949 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 16:20:12.948994 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 16:20:12.949097 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 16:20:12.949855 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:12.937699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47938 (local address 127.27.217.60:37033)
0809 16:20:12.937746 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.937748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.937756 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:20:12.937804 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.937805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.937814 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.937857 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:12.938574 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.939336 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.940502 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:12.940797 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:12.940855 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:12.943459 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 16:20:12.943460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 16:20:12.943460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 16:20:12.943467 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 16:20:12.946232 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.948136 (+ 1904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.948138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.948138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.948232 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 16:20:12.948539 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 16:20:12.948540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 16:20:12.948540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 16:20:12.948792 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 16:20:12.949481 (+ 689us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:12.949552 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 16:20:12.949687 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 16:20:12.951510 32318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47: Bootstrap starting.
I20260809 16:20:12.952270 32318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47: Neither blocks nor log segments found. Creating new log.
I20260809 16:20:12.952581 32318 log.cc:824] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47: Log is configured to *not* fsync() on all Append() calls
I20260809 16:20:12.960137 32318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47: No bootstrap required, opened a new log
I20260809 16:20:12.962446 32318 raft_consensus.cc:348] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } }
I20260809 16:20:12.962599 32318 raft_consensus.cc:729] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c993026f6f76492e8bfb9775fd62cb47, State: Initialized, Role: FOLLOWER
I20260809 16:20:12.962764 32318 consensus_queue.cc:260] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } }
I20260809 16:20:12.963204 32276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "71036d0992ac4c8390eea204f10a59d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c993026f6f76492e8bfb9775fd62cb47"
I20260809 16:20:12.963265 32275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [term 0 FOLLOWER]: Advancing to term 1
I20260809 16:20:12.964514 32275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [term 1 FOLLOWER]: Refusing update from remote peer 71036d0992ac4c8390eea204f10a59d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 16:20:12.964867 32487 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 16:20:12.965368 32276 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71036d0992ac4c8390eea204f10a59d0 in term 1.
I20260809 16:20:12.963177 32318 sys_catalog.cc:564] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 16:20:12.963162 32510 sys_catalog.cc:455] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.967912 32510 sys_catalog.cc:458] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:12.967988 32510 sys_catalog.cc:455] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71036d0992ac4c8390eea204f10a59d0. Latest consensus state: current_term: 1 leader_uuid: "71036d0992ac4c8390eea204f10a59d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.968070 32510 sys_catalog.cc:458] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 16:20:12.968109 32510 sys_catalog.cc:455] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "71036d0992ac4c8390eea204f10a59d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.968155 32510 sys_catalog.cc:458] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 16:20:12.968194 32530 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 16:20:12.968257 32530 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 16:20:12.968963 32490 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 16:20:12.969605 32512 mvcc.cc:205] Tried to move back new op lower bound from 7316653723386388480 to 7316653723301826560. Current Snapshot: MvccSnapshot[applied={T|T < 7316653723386388480}]
I20260809 16:20:12.969650 32490 catalog_manager.cc:1504] Loading token signing keys...
I20260809 16:20:12.970153 32470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "71036d0992ac4c8390eea204f10a59d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71036d0992ac4c8390eea204f10a59d0" member_type: VOTER last_known_addr { host: "127.27.217.62" port: 33515 } } peers { permanent_uuid: "c993026f6f76492e8bfb9775fd62cb47" member_type: VOTER last_known_addr { host: "127.27.217.61" port: 41289 } } peers { permanent_uuid: "129be16eda02431aae5f79e5aeadae8f" member_type: VOTER last_known_addr { host: "127.27.217.60" port: 37033 } } }
I20260809 16:20:12.970232 32470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0 [sys.catalog]: This master's current role is: LEADER
I20260809 16:20:12.974696 32490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71036d0992ac4c8390eea204f10a59d0: Generated new TSK 0
I20260809 16:20:12.974880 32490 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 16:20:13.000577 32204 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:12.999056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41758 (local address 127.27.217.62:33515)
0809 16:20:12.999101 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.999103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:12.999835 (+ 732us) server_negotiation.cc:407] Connection header received
0809 16:20:12.999947 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:12.999948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:12.999960 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:12.999991 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.000501 (+ 510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41758: BlockingRecv error: recv got EOF from 127.0.0.1:41758 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 16:20:13.001500 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:12.999491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34404 (local address 127.27.217.61:41289)
0809 16:20:12.999534 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:12.999536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.000965 (+ 1429us) server_negotiation.cc:407] Connection header received
0809 16:20:13.001061 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.001062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.001073 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.001102 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.001438 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34404: BlockingRecv error: recv got EOF from 127.0.0.1:34404 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 16:20:13.002635 32439 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.001955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47940 (local address 127.27.217.60:37033)
0809 16:20:13.001995 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.001997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.002120 (+ 123us) server_negotiation.cc:407] Connection header received
0809 16:20:13.002208 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.002209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.002220 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.002248 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.002575 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47940: BlockingRecv error: recv got EOF from 127.0.0.1:47940 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 16:20:13.005017 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.004301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34418 (local address 127.27.217.61:41289)
0809 16:20:13.004334 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.004335 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.004529 (+ 194us) server_negotiation.cc:407] Connection header received
0809 16:20:13.004630 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.004631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.004647 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.004673 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.004970 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34418: BlockingRecv error: recv got EOF from 127.0.0.1:34418 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 16:20:13.008169 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.007334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34428 (local address 127.27.217.61:41289)
0809 16:20:13.007368 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.007370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.007603 (+ 233us) server_negotiation.cc:407] Connection header received
0809 16:20:13.007723 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.007724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.007734 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.007760 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.008125 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34428: BlockingRecv error: recv got EOF from 127.0.0.1:34428 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 16:20:13.012115 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.011281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34434 (local address 127.27.217.61:41289)
0809 16:20:13.011315 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.011316 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.011553 (+ 237us) server_negotiation.cc:407] Connection header received
0809 16:20:13.011639 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.011640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.011649 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.011748 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.012072 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34434: BlockingRecv error: recv got EOF from 127.0.0.1:34434 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 16:20:13.018069 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.017283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34448 (local address 127.27.217.61:41289)
0809 16:20:13.017320 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.017322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.017578 (+ 256us) server_negotiation.cc:407] Connection header received
0809 16:20:13.017667 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.017668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.017678 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.017704 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.018023 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34448: BlockingRecv error: recv got EOF from 127.0.0.1:34448 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 16:20:13.028194 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.027290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34454 (local address 127.27.217.61:41289)
0809 16:20:13.027329 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.027331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.027606 (+ 275us) server_negotiation.cc:407] Connection header received
0809 16:20:13.027744 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.027745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.027756 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.027784 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.028128 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34454: BlockingRecv error: recv got EOF from 127.0.0.1:34454 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 16:20:13.046262 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.045533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34470 (local address 127.27.217.61:41289)
0809 16:20:13.045575 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.045577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.045717 (+ 140us) server_negotiation.cc:407] Connection header received
0809 16:20:13.045820 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.045822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.045833 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.045882 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.046208 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34470: BlockingRecv error: recv got EOF from 127.0.0.1:34470 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 16:20:13.079990 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.079272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34476 (local address 127.27.217.61:41289)
0809 16:20:13.079318 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.079320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.079447 (+ 127us) server_negotiation.cc:407] Connection header received
0809 16:20:13.079513 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.079514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.079526 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.079569 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.079929 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34476: BlockingRecv error: recv got EOF from 127.0.0.1:34476 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 16:20:13.145816 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.145107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34488 (local address 127.27.217.61:41289)
0809 16:20:13.145157 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.145160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.145283 (+ 123us) server_negotiation.cc:407] Connection header received
0809 16:20:13.145347 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.145348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.145359 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.145407 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.145752 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34488: BlockingRecv error: recv got EOF from 127.0.0.1:34488 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260809 16:20:13.275687 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.274969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34502 (local address 127.27.217.61:41289)
0809 16:20:13.275025 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.275027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.275125 (+ 98us) server_negotiation.cc:407] Connection header received
0809 16:20:13.275197 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.275198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.275210 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.275252 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.275605 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34502: BlockingRecv error: recv got EOF from 127.0.0.1:34502 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260809 16:20:13.533582 32324 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 16:20:13.532883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34508 (local address 127.27.217.61:41289)
0809 16:20:13.532956 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:13.532958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:13.532991 (+ 33us) server_negotiation.cc:407] Connection header received
0809 16:20:13.533066 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:13.533067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:13.533078 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:13.533129 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 16:20:13.533522 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34508: BlockingRecv error: recv got EOF from 127.0.0.1:34508 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 16:20:13.886615 32466 catalog_manager.cc:1259] Loaded cluster ID: 05f75b5779e54251bc43bd43e31829fd
I20260809 16:20:13.886683 32466 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f: loading cluster ID for follower catalog manager: success
I20260809 16:20:13.887497 32466 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f: acquiring CA information for follower catalog manager: success
I20260809 16:20:13.887812 32466 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 129be16eda02431aae5f79e5aeadae8f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 16:20:13.968676 32530 catalog_manager.cc:1259] Loaded cluster ID: 05f75b5779e54251bc43bd43e31829fd
I20260809 16:20:13.968753 32530 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47: loading cluster ID for follower catalog manager: success
I20260809 16:20:13.969561 32530 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47: acquiring CA information for follower catalog manager: success
I20260809 16:20:13.969849 32530 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c993026f6f76492e8bfb9775fd62cb47: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 16:20:14.049113 32633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:14.046751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34512 (local address 127.27.217.61:41289)
0809 16:20:14.046876 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:14.046878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:14.046920 (+ 42us) server_negotiation.cc:407] Connection header received
0809 16:20:14.046999 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:14.047000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:14.047051 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:14.047135 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:14.047281 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.047790 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.048487 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.048668 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.048713 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:14.048825 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:14.048931 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:14.048983 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:14.049011 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 16:20:14.049027 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260809 16:20:14.052816 32647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:14.050795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47944 (local address 127.27.217.60:37033)
0809 16:20:14.050882 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:14.050884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:14.050891 (+ 7us) server_negotiation.cc:407] Connection header received
0809 16:20:14.050937 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:14.050938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:14.050968 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:14.051033 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:14.051114 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.051575 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.052234 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.052418 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.052469 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:14.052558 (+ 89us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:14.052644 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:14.052692 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:14.052720 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 16:20:14.052738 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71,"thread_start_us":46,"threads_started":1}
I20260809 16:20:14.056775 32647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:14.054356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47948 (local address 127.27.217.60:37033)
0809 16:20:14.054392 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:14.054394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:14.054548 (+ 154us) server_negotiation.cc:407] Connection header received
0809 16:20:14.054621 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:14.054622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:14.054630 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:14.054677 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:14.054803 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.055481 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.056229 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.056442 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.056506 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:14.056589 (+ 83us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:14.056615 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:14.056660 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:14.056693 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 16:20:14.056710 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:20:14.057353 32633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:14.054217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34516 (local address 127.27.217.61:41289)
0809 16:20:14.054259 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:14.054261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:14.054419 (+ 158us) server_negotiation.cc:407] Connection header received
0809 16:20:14.054467 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:14.054468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:14.054479 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:14.054528 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:14.054640 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.055350 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.056399 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.056669 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.056726 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:14.057035 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:14.057066 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:14.057113 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:14.057260 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 16:20:14.057283 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 16:20:14.057634 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 16:20:14.054216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41770 (local address 127.27.217.62:33515)
0809 16:20:14.054548 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0809 16:20:14.054550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 16:20:14.054558 (+ 8us) server_negotiation.cc:407] Connection header received
0809 16:20:14.054603 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 16:20:14.054604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 16:20:14.054653 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 16:20:14.054739 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 16:20:14.054901 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.055384 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.056776 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 16:20:14.057070 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 16:20:14.057130 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 16:20:14.057326 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 16:20:14.057400 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 16:20:14.057449 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 16:20:14.057528 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 16:20:14.057560 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":51,"threads_started":1}
I20260809 16:20:14.059190 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 32091
I20260809 16:20:14.073984 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 32210
I20260809 16:20:14.083760 28516 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXqQsw3/build/release/bin/kudu with pid 32327
2026-08-09T16:20:14Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2900 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5782 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (270957 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST